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"Solid Tumor, Cortical Function, and Nerve Imaging" 

5 TECHNICAL FIELD OF THE INVENTION 

The present invention provides a method for real-time detection of solid tumor 
tissue, plus an ability to grade and characterize tumor tissue. The present invention 
further provides a method for real-time mapping of functional and dysfunctional 
cerebral cortex and nervous tissue. The present invention further provides a device for 
10 real-time detection and optical ima^g for the inventive methods. 

BACKGROUND OF THE INVENTION 

A primary goal of neurological surgeiy is the complete removal of abnormal or 
pathological tissue while sparing normal areas. Hence, the neurosurgeon attraipts to 

1 5 identify boundaries of pathological or dysfunctional tissue and to map adjacent areas of 
the cortex committed to important functions, such as language, motor and sensory areas 
so that pathological/dysfunctional tissue is removed without removing functional areas. 

Incidence rates for primary intracraiual brain tumors are in the range of 50-150 
cases per million population or about 18,000 cases per year (Berens et al, 1990). 

20 Approximately one half of brain tumors are malignant. The incidence of malignant brain 
tumors in adults is predominantly in the age range of 40-55 years vAnle the inddence of 
more benign tumors peaks near 35 years of age. A primary means for treatment of such 
tumors is surgical removal. Many studies have shown that when more of the total 
amount of tumor tissue is removed, the better the climcal outcome. For gross total 

25 resections of tumors, the 5-year survival rate is doubled when compared to subtotal 

resection. Both duration of survival and independent status of the patient are prolonged 
when the extent of resection is maximized in malignant gliomas. Current intraoperative 
techniques do not provide rapid differentiation of tumor tissue from normal brain tissue, 
especially once the resection of the tumor begins. Development of techniques that 

30 enhance the ability to identify tumor tissue intraoperatively may result in maximizing the 
degree of tumor resection and prolonging survival. 

Of the 500,000 patients projected to die of systemic cancer per year in the 
United States, approximately 25%, or over 125,000 can be expected to have 
intracranial metastasis. The primaiy focus for surgery in this group is m those patients 

35 with single lesions who do not have widespread or progressive cancer. This group 
represents about 20-25% of patients wth metastases (30,000), however, the actual 
number of patients that are good candidates for surgery is slightly smaller. Of those 
patients undergoing surgery, one half i^ll have local recurrence of thdr tumor at the 
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site of operation, while the other half will develop a tumor dsewhere. The &ct that 
about 50% of the surgeries fail at the site of operation means that an improved abilhy to 
remove as much tumor as possible by detecting and localmng tumor margins during 
tumor removal could potentially decrease the incidence of local recurmce. 

5 Thus, for both primary and metastatic tumors, the more tumor tissue removed, 

the bettCT the outcome and the longer the survival. Further, by maximizing the extent of 
resection, the length of functional, good quality survival is also increased. 

Most current tumor imaging techniques are performed before surgery to provide 
information about tumor location. Presurgeiy imaging methods include magnetic 

10 resonance imaging (MRI) and computerized tomography (CT). In the operating room, 
only intraoperative uhrasound and stereotaxic systems can provide information about 
the location of tumors. Ultrasound shows location of the tumor from the surface but 
does not provide information to the surgeon once surgery begins to prevent destruction 
of important functional tissue wlule permitting maximal removal of tumor tissue. 

15 Stereotaxic systems coupled with advanced imaging techniques have (at select few 

hospitals) been able to localize tumor margins based upon the preoperative CT or MRI 
scans. However studies (Kelly, 1990) have shown that the actual tumor extends 2-3 cm 
beyond where the image enhanced putative tumor is located on preoperative images. 
Therefore, the only current reliable method to determine the location of tumors is by 

20 sending biopsies during surgery (/,e., muhiple histological nuupn sampling) and waiting 
for results of microscopic examination of frozen sections. Not only is it not advisable to 
continually take breaks during surgery, but such biopsies are, at best, an estimation 
technique and are subject to sampling errors and incorrect readings as compared to 
permanent tissue sections that are available about one week later. Thus, a surgeon 

25 often relies upon an estimation technique as a guide when patient outcome is dependent 
upon aggres^ve removal of tumor tissue. Surgeons have difficult decisions between 
aggressively removing tissue and destroying surrounding functional tissue and may not 
know the real outcome of their procedure until one week later and this may require an 
additional surgical procedure. 

30 Muhiple histological margin sampling suffers several drawbacks. First this is a 

time-consuming procedure as it can add about 30 to 90 minutes (depending upon the 
numb^ of samples taken) to a surgical procedure when the patient is under anesthesia. 
Second, tlus procedure is prone to errors as a pathologist must prepare and evaluate 
samples in short order. Third, it is certsunly the case that mar^n sampling does not 

35 truly evaluate all regions surrounding a primary tumor as some areas of residual tumor 
can be missed due to sampling error. Fourth, increased time for margin sampling is 
expensive as operating room time costs are high and this leads to increased overall 
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medical costs. Moreover, increased operating room time for the patient increases the 
probability of infection. 

Other techniques developed to. improve visual imaging of solid tumor masses 
during surgery mdude determining the shape of ^osible luminescence spectra from 

5 normal and cancerous tissue. Accordii^ to US Patent 4,930,516, in cancerous tissue 
there is a shift to blue with different luminescent intensity peaks as compared to normal 
tissue. This method involves exdting tissue with a beam of ultraviolet (UV) light and 
comparing visible native limiinescence emitted from the tissue with a historical control 
from the same tissue type. Such a procedure is fraught with di£5culties because a real 

10 time, spatial map of the tumor location is not provided for the use of a surgeon. 

Moreover, the use of UV light for an excitation wavelength can cause photodynamic 
changes to normal cells, is dang^ous for use in an operating room, and penetrates only 
superfidally into tissue and requires quartz optical components instead of glass. 
Therefore, there is a need in the art for a more comprehen^e and fester 

1 5 techiuque and a device for as^sting such a technique to localize for soUd tumor 

locations and map precise tumor mar^s in a real-time mode during surgery. Sudi a 
device and method should be fiirther useful for inexpensive evaluation of any solid 
tumor (e,g., breast mammography) by a noninvasive procedure and capable of grading 
and characteri^ng the tumors. 

20 There is also a need to image brain functioning during nairosur^cal procedures. 

For example, a type of neurosur^cal procedure which also exemplifies these principles 
is the surgical treatment of intractable epilepsy (that is, epilepsy which cannot be 
controlled with medications). Presentiy, dectroencephalography (EEG) and 
electrocorticography (ECoG) techniques are used prior to and during surgery for the 

25 purposes of identifying^areas of abnormal brain activity, such as epileptic foci. These 
measurements provide a direct measurement of the brain's electrical activity. 

Intraoperative EEG techniques involve pladng an array of electrodes upon the 
surface of the cortex. This is done in an attempt to localize abnormal cortical activity of 
epileptic seizure discharge. Although EEG techniques are of widespread use, hazards 

30 and limitations are associated with these techniques. The size of the electrode sur&ce 
and the distance between electrodes in an EEG array are large with respect to the size 
of brain cells (e.g., neurons) with epileptic foci. Thus, current techniques provide poor 
spatial resolution (approximately 1 .0 cm) of the areas of abnormal cortical activity. 
Further, EEG techniques do not provide a map of normal cortical fiinctipn in response 

35 to external stimuli (such as being able to identify a cortical area dedicated to speech, 
motor or sensory functions by recording electrical activity while the patient speaks). A 
modification of this technique, called cortical evoked potentials, can provide some 
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functional cortical mapping. However, the cortical evoked potential technique sujSers 
from the same spatial resolution problems as the EEG technique. 

The most common method of intraoperative localization of cortical fimction in 
epilepsy and tumor surgery is direct electrical stimulation of the cortical ^irface vath a 

5 stimulating electrode. Using this technique, the surgeon attempts to evoke dther an 
observed motor response from specific parts of the body, or in the case of an awake 
patient, to generate spedfic sensations or cause an interruption in the patient*s speech 
output. Again, this technique suffers from the same problems as the EEG technique 
because it offers only crude spatial localization of fimction. 

10 Possible consequences of the inaccuracies of all these techniques, when 

employed for identifying the portion of the cortex respon^ble for epileptic sdzures in a 
patient, are dther a greater than necessaiy amount of cortical tissue is rmoved posdbly 
leaving the patient with a deficit in function, or that not enough tissue is removed 
leaving the patient uncured by the surgery. Despite these inadequades, such techniques 

IS have been deemed acceptable treatment for intractable epilepsy. The same prindples 
apply to tumor surgeries, however, intraoperative functional mapping is not performed 
routinely. 

In the past few years, researchers have been using imaging techniques in animal 
models to identify functional areas of cortex with high spatial resolution. One type of 

20 such techmque uses a vohage-sensitive dye. A voltage-sensitive dye is one i^ose 
optical properties change during changes in electrical activity of neuronal cells. The 
spatial resolution achieved by these techniques is near the single cell level. Blasdd and 
Salama (Nature 321 :579, 1986) used a voltage-soiative dye (merocyanine oxazolone) 
to map cortical function in a monk^ model. The use of these kinds of dyes would pose 

25 too great a risk for' use in humans in view of their toncity. Further, such dyes are 
bleached by light and miist be infused frequently. 

Recently, measurement of intrinsic signals have been shown to provide similar 
spatial resolution as voltage-sensitive dye imaging. Intrinsic signals are light reflecting 
changes in cortical tissue partially caused by changes in neuronal activity. Unlike other 

30 techniques used for imaging neuronal activity, imaging intrinsic signals does not require 
using dyes (which are often too toxic for clinical use) or radioactive labels. For 
example, Grinvald et al. (Nature 324:361, 1986) measured intrinsic changes in optical 
properties of cortical tissue by reflection measurraents of tissue in response to 
electrical or metabolic activity. Light of wavelength 500 to 700 nm may also be 

35 reflected differently between active and quiescent tissue due, to increased blood flow 
into regions of higher neuronal activity. Another aspect which may contribute to 
intrinsic signals is a change in the ratio of oxyhemoglobin to deoxyhemoglobin. 
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Ts*o et al. (Science 249:417, 1990) used a charge-coupled de^ce (CCD) camera 
to detect intrinsic signals in a monkey modd. However, this technique would not be 
practical in a clinical mvironment because ima^g was achieved by implanting a 
stainless sted optical chamber m tfie skull and in ord^ to achieve suffident ^gnal to 
5 noise ratios, Ts*o et al. had to average images over periods of time greater than 30 
minutes per image. By comparison to all other known techniques for localiang cortical 
function, imaging intrinsic signals is a relatively non-invasive technique. 

Mechanisms responsible for intrinsic signals are not well understood, pos^ble 
sources of intrinsic signals include dilatation of small blood v^sels, increased scattering 
10 of light from neuronal activity-dependent rdease of potassium, or fix>m swelling of 
neurons and/or glial cells. 

Therefore, there is a need in the art for a procedure and apparatus for real-time 
optical imaging of cortical tissue whidi can predsdy and qiuckly distingiush normal and 
abnormal cortical tissue. There is also a need in the art for developing a method that 
15 can image intrinsic dgnals with high spatial resolution, provide imme^e images and 
be compatible \^tb normal procedures in the operating room. Tins invention was made, 
in part, in an effort to satisfy this need. 

SUMMARY OF THE INVENTION 

20 The inventive method and device can be used to identify, grade and characterize 

solid tumors by ima^g changes in electromagnetic absorption which reflects dynamics 
of dye perfusion through tissue, wherdn the inventive device is able to difif^entiate 
tumor tissue from surrounding norma) tissue with dynamic changes in optical signals 
during dye perfusion. Further, the inventive method and device can be used to identify 

25 areas of neuronal activity during neurosur^cal procedures. In particular, this mvention 
can be used by a neurosurgeon intraoperatively to identify areas in the brain de<ticated 
to important functions such as viaon, movement, sensation, memory and language. 
Further the present inventive method and device can be used to detect areas of 
abnormal cortical activity, such as epileptic fod. Lastly, the present invention can be 

30 used to identify individual nervres during neurosurgical procedures for tumor removal or 
anastamoses of severed nerves. 

The present invention provides an apparatus for imaging tumor tissue or for 
real-time surgical imaging of cortical intrinsic signals or visualizing margins of solid 
tumor tissue from dynamic changes in optical signals during dye perfusion, comprising, 

35 a means for obtaining a series of analog video signals, and a means for processing the 
analog ^ddeo signals into either an averaged control image or a subsequent averaged 
image, a means for acquiring and analyzing a plurality of subsequent images and 
averaged control images to provide a difference image, wherdn the difference image is 
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processed to account for movraient and noise and to amplify the changes across a 
dynamic range of the apparatus, and a means for displaying the difference image alone 
or superimposed over an analog video image. 

The present invention fiirther provides a method for imaging tumor mar^ and 

5 dimensions of solid tumor tissue located in an area of interest, compri^g illimiinating 
the area of interest with spatially even, intensive and non fluctuating light containing a 
wavelength of electromagnetic radiation (emr) (e.g., light) absoibed by a dye, obtaining 
a video signal of the area of interest as a series of frames and procesang the series of 
frames into an averaged control image, administering the dye by bolus injection into 

10 vasculature circulating to the area of interest, obtaming a subsequent saies of frames of 
the area of interest over time and processing the subsequrat series of frames into a 
subsequent averaged image, comparing each subsequent averaged image mth the 
averaged control image to obtam a series of difference images, and comparing each 
difference image for iiutial evidence of changed optical signals within the area of interest 

1 5 vAndti is the outline of solid tumor tissue, wherein tumor tissue is characterized by 
different kinetics of dye uptake compared to normal tissue and a temporally changed 
pattern of altered absorption of light as a result of increased vascularity of solid tumor 
tissue. Examples of appropriate dyes include indocyanine, fluorescein, 
hematoporphyrin, and fluoresdamine. A preferred dye is indocyamne green which has a 

20 broad absorption wavelength range and a peak absorption in the range of 730 nm to 
840 nm. 

The present invention fluther comprises a method in real-time for optically 
imaging fimctional areas of interest of the cortex in a patient compriang illununating the 
area of interest with lugh intensity emr containing near-infrared wavelengths of emr, 

25 obtaining a series of frames of the area of interest and processing the series of frames 
into an averaged control image, administering a stimulus paradigm to the patient to 
stimulate an intrinsic signal, obtaining a series of subsequent frames of the area of 
interest over time and processing the subsequent series of frames into a subsequent 
averaged image, comparing each subsequent averaged image with the averaged control 

30 image to obtain a series of difference images, and comparing each difference image for 
initial evidence of an intrinsic signal within the area of interest, whereby an intrinsic 
signal is characterized by a change in emr reflectance properties manifest as a signal in 
the difference image. 

The present invention fiirther includes a method for ima^ng damage to a 

35 peripheral or cranial nerves comprising: (a) illununating an area of int^est whh high 
intensity emr, wherein the area of interest comprises the peripheral nerve of interest 
including the suspected site of damage and a region adjacent of the suspected site of 
damage; (b) obtaining a series of frames of the area of interest and processing the series 
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of frames into an averaged control image; (c) stimulating the peripheral or cranial nerve 
at a ^e adjacent of the suspected damaged site; (d) obtmning a series of subsequent 
frames at the time of stimulation and processing the series of subsequent frames into a 
subsequent averaged image; and (e) obtaining a difference image by subtracting the 

5 averaged control unage from the subsequent averaged image to visualize the active 
region of the periph^al or cranial nerve, whweby nerve blockage is visualized as the 
point along the nerve where the intrinsic signal from the stimulated nerve abruptly ends, 
or is altered, attenuated or diminished in the difference image. 

The present invention further includes a method for imaging tumor tissue 

10 surrounding or adjacent to nerve tissue to idd in selective resection of tumor tissue 
without destroying nerve tissue, compriang: (a) illuminating an area of interest with 
high intensity emr containing wavelength of emr absorbed by a dye; (b) obtaining a 
series of frames of the area of interest and processing the series of frames into an 
averaged control image; (c) stimulating the nerve; (d) obtaining a series of subsequent 

15 nerve fr^es and processing the subsequent series of nerve fi^ames into a subsequent 
nerve averaged image; (e) obtaining a nerve difference image by subtracting the nerve 
averaged control image from the nerve subsequent averaged image to visualize the 
active nerve; (f) adrmnistering a dye into an artery feeding the area of interest; (g) 
obtaining a series of tumor subsequent frames and processing the tumor subsequait 

20 series of frames into a tumor subsequent averaged image; and (h) obtaining a tumor 
difference image by subtracting the tumor averaged control image from the tumor 
subsequent averaged image to create a tumor difference image that is capable of 
visualizing the tumor. Further, the tumor difference image and the nerve difference 
image can be superimposed upon each other to simultaneously visualize the relative 

25 locations of tumor tissue and nervous tissue. 

The present invention further comprises a method for enhandng sensitivity and 
contrast of the images obtained from tumor tissue or intrinsic signal difference images, 
comprising: (a) illuminating an area of interest with a plurality of wavelengths of emr, 
wherein there is at least a first wavelength of emr and a second wavelength of emr; (b) 

30 obtaining a sequence of frames corresponding to each wavelength of emr, wherein a 
first sequence of frames is from the first wavelength of emr, the second sequence of 
frames is from the second wavelength of emr and so on; (c) processmg the first 
sequence of frames into a first averaged control image, the second sequence of frames 
into a second averaged control image and so on; (d) stimulating for intrinsic signals or ~ . 

35 admirustering a dye for tumor tissue imaging; (e) obtmning a first series of subsequent 
frames using the first wavelength of emr, a second series of subsequent frames using the 
second wavelength of emr, and so on, and processing the first, second and so on 
subsequent series of frames into the first, second and so on subsequent averaged 
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images, respectively; (f) obtaining a first difference image by subtracting the first 
averaged control image firom the first subsequent averaged image and a second 
diffi^race unage by ^btracting the second averaged control image firom the second 
subsequent averaged image, and so on; and (g) obtaining an enhanced difference image 
S by ratioing the first difference image to the second difference image. Preferably, the 
monochromatic emr sources to illuminate the area of interest are fi-om laser sources. 
This technique is usefiil for obtaining three dnnenaonal information of the area of 
interest. 

10 BRIEF DESCRIFnON OF THE DRAWINGS 

Figure 1 illustrates a view of human cortex just anterior to face-motor cortex 
vnth one recording (r) and two stimulating electrodes (s), and three sites (#1, #2, #3) 
where average percent changes were detemuned. The scale bar equals 1 cm. Averages 
of 128 images (4/sec) were acquu-ed at 30 Hz and stored (1/sec). After acquiring 3-6 

1 S averaged control images (5 sec/image), a bipolar cortical stimulation evoked 
epileptiform afterdischarge activity. 

Figure 1 A is a view of a human cortex just anterior to face-motor cortex with 
one recording electrode (r) and two stimulating electrodes (s), and four sites (the boxed 
areas labeled 1, 2, 3, and 4) where the average pa-cent changes of absorption over these 

20 areas were determined. The cortex was illuminated with emr >690 ran. The scale bar is 
1 cm. 

Figure IB are plots of the percent change of emr absoiption per second in the 
spatial re^ons of boxes 1 and 3 (as labeled in Figure 1 A). For both rpgjons, the peak 
change is during the fourth stimulation trial (at 8 mA) in which the greatest amount of 

25 stimulating current faad induced the most prolonged epileptiform afterdischarge activity. 
The changes witlun box 3 were greater and more prolonged than those of box 1 . Box 3 
was overiying the area of the epileptic focus (the excitable area of tissue possibly 
responsible for the patient's epilepsy). 

Figure IC show plots of the percent change of emr absorption per second in the 

30 spatial regions of boxes 1 and 4 (as labeled in Figure lA). Box 1 overlays and area of 
cortical tissue between the two stimulating electrodes, and box 4 overlays a blood 
vessel. The changes within box 4 are much larger and in the opposite direction of box 
1 . Also these changes are graded with the magiutude of stimulating current and 
afterdischarge activity. Since the changes in box 4 are most likely diie to changes of the 

35 blood-flow rate within a blood vessel, this plot shows that the invention can 
simultaneously monitor cortical activity and blood-flow. 

Figure ID shows plots of the percent change of emr absorption per second in 
the spatial regions of boxes 1 and 2 (as labeled in Figure 1 A). Note that although these 
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two areas are nearby each other, their optical changes are in the oppo^ direction 
during the first three stimulation trials u^g 6 mA current. The negative going changes 
within the region of box 2 indicate that the invention may be used to monitor inhibition 
of cortical activity as well as exdtadon. 

S Figure 2 iUustrates a spatial map of stimulation induced epileptiform activity. 

This Figure shows a con^arison between different degrees of activation for both spatial 
extent and amplitude of optical change graded with the extent of cortical activity. 
Spedfically, Figure 2 shows percentage difference images from various times during 
two stimulation trials (definition of stimulation trial is given in desoiption of Figure 1) 

10 from those described in Figure 1. The top 3 pictures (A2, B2, and C2) are from 
stimulation trial 2 where 6 mA cortical stimulation evoked a brief period of 
aft^discharge. These are compared to the bottom three pictures (A4, B4, and C4) 
which are from stimulation trial 4 showing the optical changes evoked by cortical 
stimulation at 8 mA. Figures 2, A2 and A4 compare control images during rest. 

IS Figures 2, B2 and B4 compares the peak optical changes occurring during the 

epileptiform afterdischarge activity. Figures 2, C2 and C4 compares the degree of 
recovery 20 seconds after the peak optical changes were observed. The magnitude of 
optica] change is indicated by the gray*scale bar in the center of the Figure. The arrow 
beside this gray-scale indicates the direction of increadng amplitude. Each image maps 

20 an area of cortex approximately 4 cm by 4 cm. 

Figure 3 shows a sequence of dynamic changes of optical agnals identifying 
active areas and seizure foci. This Figure shows dght percentage differrace images 
from the stimulation trial 2 described in the previous two Figures. Each image is 
integrated over a two second interval. The focal area of greatest optical change is ui the 

25 colter of images 3, 4, and S, indicating the region of greatest cortical activity. This 
re^on is the epileptic foCus. The magnitude of optical change is indicated by the gray- 
scale bar on the right side of the Figure. The arrow beside this gray-scale indicates the 
direction of increaang amplitude. Each image maps an area of cortex approximately 4 
cm by 4 cm. 

30 Figure 4 illustrates a real-time sequence of dynamic changes of stimulation- 

evoked optical changes in human cortex. Figure 4, panels 1 through 8, show eight 
consecutive percentage difference images, each image is an average of 8 fi^es ( < 1/4 
second per image). The magnitude of optical change is indicated by the gray-scale bar 
in the center of the Figure. The arrow beside this gray-scale indicates the direction of 

3S increasing amplitude. Each image maps to an area of cortex that is approximately 4 cm 
by 4 cm. This Figure demonstrates that the inventive device and method can be used to 
map, in real time, dynamics of optical changes and present such information to the 
surgeon in an informative format. 
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Figure 5 shows an activation of somatosensory cortex by stimulation of a 
peripheral nerve in an anesthetized rat (afferent sensory input by directly stimulating the 
sdatic n^e in the hind limb of a rat). The leftmost image is a gray-scale image of Mnd 
limb somatosensory cortex in an anesthetized rat. The magnification is sufficiently high 

S so that individual capiUaries can be distinguished (the smallest vessels visible in this 
image). The center image is an image of a percentage difference control optical image 
during rest. The magnitude of optical change is indicated by the gray-scale bar in the 
center of this image. The arrow beside this gray-scale mdicates the direction of 
increasing amplitude. The rightmost image is a percentage difference map of the optical 

10 changes in the hind limb somatosensory cortex during stimulation of the sciatic nenre. 
Figure 6 shows iimctional mapping of human language (Broca*s area) and 
tongue and palate sensory areas in an awake human patient. During three "tongue 
wiggling** trials images were averaged (32 fi^es, 1 sec) and stored ev^ 2 seconds. A 
tongue wiggling trial consisted of acqiuring S-6 images during rest, then acquiring 

15 images during the 40 seconds that the patient was required to wiggle his toiigue against 
the roof of his mouth, and then to continue acquiring images during a recovery period. 
The same patient engaged in a •'language naming" trial. A language naming trial 
consisted of acquiring 5-8 images during rest (control images - the patient silently 
viewing a series of blank slides), then acquiring images during the period of time that 

20 the patient engaged in a naming paradigm (naming a series of objects presented with a 
slide projector every 2 seconds, selected to evoke a large response in Broca*s area), and 
finally a series of images during a recovery period foUo^ng a time when the patient 
ceased his naming task (again viewing blank slides wMle remaining silent). Images Al 
and Bl are gray-scale images of an area of human cortex with left bdng anterior, right- 

25 posterior, top-superior, and the Sylvan fissure on the bottom. The two asterisks on Al, 
Bl, A2, and B2 serve as reference points between these images. The scale bars in the 
lower right comer of Al and Bl are equal to 1 cm. In Al, the numbered boxes 
represent sites where cortical stimulation with electrical stimulating electrodes evoked 
palate tingling (1), tongue tingling (2), speech arrest-Broca's areas (3,4) and no 

30 response (11, 12, 17, 5-premotor). Image A2 is a percentage difference control image 
of the cortex during rest in one of the tongue wiggling trials. The gray-scale bar on the 
right of A2 shows the relative magnitude of the color code associated with images A2, 
A3, B2 and B3. Image A3 is a percentage difference map of the peak optical changes 
occurring during one of the tongue wiggling trials. Areas identified as tongue and 

35 palate sensory areas by cortical stimulation showed a laige podtive diange. 

Suppression of baseline noise in surrounding areas indicated that, during the tongue 
wiggling trials, language-motor areas showed a negative-going optical signal. Image 
B2 is percentage difference control image of the cort^ during one of the language 
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naming trials. Image B3 is a percentage difference image of the peak optical change in 
the cortex during the language naming task. Large poative^oing agnals are present in 
Broca*s area. Negative-going »gnals are present in tongue and palate sensory areas. 
Figure 7 shows a time course and magnitude plot of dynamic optical changes in 

5 human cortex evoked in tongue and palate sensory areas and in Broca's area (language). 
This Figure shows the plots of the percentage change in the optical absorption of the 
tissue within the boxed regions shown in Figure 6, images Al and Bl, during each of 
the three tongue wiggling trials and one of the language naming trials (see, description 
of Figure 6). Diagram 7A shows the plots during the three tongue wiggling trials 

10 averaged spatially within the boxes 1, 2, 3« and 4 as identified in Figure 6, image Al . 
Diagram 7B shows the plots during one of the language naming trials averaged spatially 
within the boxes 1-7 and 17. 

Figure 8 illustrates an optical map of a cortical area important for language 
comprehension (Wermcke's area) in an awake human. Figure 8 image A shows the 

15 cortical surface of a patient where the anatomical orientation is left-antoior, bottom- 
inferior, with the Sylvan fissure running along the top. After optical ima^g, all 
cortical tissue to the left of the thick line was sur^cally removed. Sites #1 and #2 were 
identified as essential for speech (e.g., cortical stimulation blocked ability of subject to 
name objects). At site #3, one naming error in 3 stimulation trials was found. As the 

20 surgical removal reached the area labeled by the asterisks on the thick line, the patient*s 
language deteriorated. All the unlabeled sites in Figure 8A had no errors while naming 
slides during cortical stimulation. Figure 8, image B shows an ova:^lay of a percentage 
difference image over the gray-scale image of the cortex acqiured during a language 
nammg trial (see. Figure 6 for description of the language naming trial). The magnitude 

25 of the optical change is shown by the grs^-scale bar on the lower right of the image. 
Tins image demonstrates how a surgeon might use this invention tntraoperativdy to 
map language cortex. 

Figure 9 illustrates a timecourse and magnitude of dynamic optical changes in 
human cortex evoked in Wernicke's area Oanguage comprehension). Figure 9A shows 

30 plots of percentage change in optical absorption of tissue within the boxed regions 
shown in Figure 8. The plots of boxes 1 and 2 overiay essential language sites, and 
boxes labeled 4, 5, and 6 overiay secondary language sites. Each of these five ^^ts 
showed significant changes occurring while the patient was engaged in a language 
naming task. Figure 9B show percentage changes fi*om the six unlabeled boxes shown 

35 in Figure 8. There were no significant increases or decreases witlun these anterior ^tes. 
Figure 10 illustrates differential dynamics of dye to identify low grade human 
CtiS tumor. Tins series of images are fi-om a patient having a low grade CNS tumor 
(astroc^oma, grade 1). In Figure lOA (upper left) the lettered labels placed upon the 
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brain by the surgeon overlay the tumor as idmdfied intraoperatively by ultrasound. 
However, tumors of tUs type and grade are notoriously difficult to distinguish from 
normal tissue once the surgical removal of the tumor has begua Figure lOB (middle 
left) shows a diflFerence image taken approximately 15 seconds after intravenous 

5 injection of dye (indocyanine green at 1 mgAcg). Figure IOC (lower left) shows the 
difference image about 30 seconds after dye administration. The area of the tumor 
tissue showed the first tissue staining. Figure lOD (top right) shows that in tMs low 
grade tumor, all tissue (both normal and abnormal) showed staining at 45 sec after dye 
administration. Figure lOE (middle right) is one minute after dye adnrunistration and 

10 Figure lOF is five minutes after dye administration (showing complete clearance in this 
low grade tumor). These data show that indocyaiune green enters low grade tumor 
tissue faster than normal br^n tissue, and may take longer to be cleared from betugn 
tumor tissue than nonnal tissue, providing utility to image even low grade tumors, and 
to distingdsh intraoperatively, low grade tumor tissue from surrounding normal tissue. 

15 Figure 1 1 illustrates that differential dynamics of dye identify malignant human 

CNS tumor. The series of images in this Figure are from the cortex of a patient with a 
malignant CNS tumor (glioblastoma; astrocytoma. Grade IV). Figure 1 1 A (upper left) 
shows a gray-scale image in which malignant brain tumor tissue was doisest in the 
center and to the right but elsev^ere was mostly normal tissue (as was shown by 

20 pathology slides and flow (^ometry available one week after surg^). Figure 1 IB 
- (middle left) is the difference image at 1 5 seconds after intravenous iiqection of 
indocyanine green, shovynng the dynamics of dye perfiiaon in the first seconds in 
malignant tissue are similar to those in the first few seconds of bemgn tumor tissue (see 
Figure 1 IC). Figure 1 IC (lower left) shows that at 30 seconds the malignant tissue is 

25 even more intense by comparison to the normal tissue. Figure 1 ID (upper right, 1 
minute after dye injection) and 1 IE (lower right, 10 minutes after dye injection) show 
that unlike benign tumor tissue, in malignant tumor tissue, dye is retained significantiy 
longer, and in some cases, continues to sequester in the malignant tumor tissue over 
longer periods of time. These data illustrate a utility to identify malignant tumor tissue, 

30 distinguish intraoperatively between normal and malignant tumor tissue, and to 

distinguish between the various grades of tumor (e.^,, normal vs. benign vs. malignant). 

Figure 12 shows that diflferential dynamics of dye identify small renmants of 
tumor tissue in the mai^n of a resected malignant human CNS tumor. The images are 
from an area of interest where a tumor was surgically resected and biopsies were taken - 

35 for multiple histolo^cal margin sampling. The area of interest was thought to be free of 
tumor tissue after the surgical removal of the tumor Normally, in this size of a 
resection margin, only a single frozen sample would be taken for pathology analysis. 
For the purpose of this study, five biopsies were taken from the maigin to aid in 
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correlating the histology with the map obtained by the invention. Figure 12A (top left) 
shows a gray-scale image of the tumor mar^n. Figure 12B shows the margin with 
labels that the surgeon placed directly on brain. The puipose of these labels were to 
identify where the surgeon was gping to remove biopsy samples for histological analysis 

5 after difference images were acquired with the inventive device. Figure 12C (lower left) 
shows the difference image 1 minute after mtravenous injection of dye and Figure 12D 
(lower right) shows the difference image 10 minutes after dye injection. These post-dye 
difference images reveal a number of sights that contain tumor tissue as well as areas of 
normal tissue. The accuracy of the optical ima^ng was confirmed post operatively by 

10 analysis of the biopsies. Note that a small area on the lower right of Figure 12D 
indicates a possible region of tumor tissue that would not have been biopsied by the 
surgeon. Hence, even in the case of extensive biopsy, the sampling OTor exceeds the 
accuracy of the invention. These data show a utility to identify small remnants of tumor 
tissue in a tumor margin after resection of a tumor 

1 S Figure 1 3 shows that differential dynanucs of dye can identify and characterize 

tumors in human patients that do not contrast enhance with MRI imaging. A 
proportion of non-benign tumors are not obs^vable with present MRI imaging 
techniques. The images in this Figure are from a patient whose tumor did not contrast 
enhance with MRI, This lack of enhancement is usually typical of benign tumors. 

20 However, optical imaging was able to identify this tumor as a non-benign type (an 
anoplastic astrocytoma as shown one week later by pathology and flow cytometry). 
Figure 13 A shows the gray-scale image of the area of interest. Figure 13B shows the 
difference image prior to dye injection. Figure 13C shows the area of interest 1 minute 
after intravenous dye injection, and Figure 13D shows the area of interest S minutes 

25 after dye injection. Notelhat the dye is retained in tins tissue for a significant time. As 
shown in figures 10, 1 1, and 12, this dynamic tnit is a characteristic of a non-benign 
tumor. 

Figure 14 shows non-invasive imaging of dye dynamics and identification of 
glioma through the intact cranium. This figure demonstrates that the invention can be 

30 used to identify tumors through the intact cranium. Figure 14A is a gray-scale image of 
the cranial surface of a rat. The sagital suture runs down the center of the image. 
Tumor cells had been injected into the left side some days earii^ so that this animal had 
developed a glioma on the left hemisphere of its brain. The right honisphere was 
normal. Box 1 lays over the suspect region of brain tumor, and box 2 lays over normal 

35 tissue. Figure 14B is a ctifference image 1 second after indocyanine green dye had been 
intravenously injected into the animal. The region containing tumor tissue became 
immediately visible through the intact cranium. Figure 14C shows that S seconds after 
dye injection the dye can be seen to profuse through both normal and tumor tissue. 
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Figure 14D shows that 1 minute after dye injection, the normal tissue had cleared the 
dye, but dye was still retained in the tumor re^on. The concentration of dye in the 
center of this difference image was dye drculating in the sagital sinus. 

Figure 1 S illustrates dynamic information of dye uptake and clearance in tumor 
5 vs, non-tumor tissue through the intact skull. This is a plot of an average of the 

percentage change in emr absorption av^age over the spatial areas indicated by boxes 1 
and 2 from Figure 14A. The increase in absorption was a fimction of the concentration 
of dye in the tissue at a particular time. The graph labeled "extracranial tumor" is a plot 
of the dynamics of the absorption changes within box 1 from Figure 14 A. The graph 

10 labeled "extracranial: normal*' is a plot of the dynanucs of the absorption change witiun 
box 2 from Figure 14A. 

Figure 16 shows a spatial map of dynamic changes iii tumor vs. non-tumor areas 
in the rat glioma model. The sequence of images in this figure demonstrate the dynamic 
differences of the absorption changes due to dye between tumor and non-tumor tissue. 

1 5 Figure 1 6A shows a gray-scale imzgt of the area of interest. Tins is the same animal as 
shown in Figure 14, however the cranium has now been removed so as to expose the 
left hemisphere containing the glioma, and the right hemisphere containing normal 
tissue. Box 1 overlays the tumor. Box 2 the tumor-surround, and Box 3 overiays 
normal tissue. Figure 16B shows the differmce image of the area of interested 1 second 

20 after 1 mg/kg of indocyanine green had been intravenously injected into the animal. 
During this initial time, the tumor tissue was the first to show a measurable optical 
change indicating the uptake of dye occurs first in the tumor tissue. The gray-scale bar 
indicated the relative magnitude of the optical changes in the sequence of difference 
images. Figures 16C and 16D show difference images of the area of interest 4 seconds 

25 and 30 seconds, respectively, after dye injection. At these intermediate stages dye 
appears to collect in both normal and tumor tissue. Figures 16E and 16F show 
difference images of the area of interest 1 minute and 5 minutes, respectively, after 
injection of dye. At these later times, it becomes clear that dye was still collecting in 
tumor tissue even thought it was being cleared from normal tissue. 

30 Figure 1 7 shows dynamic information of dye uptake and clearance in tumor vs. 

non-tumor tissue. This is a plot of an average of the percentage change in emr 
absorption averaged over the spatial areas indicated by boxes 1, 2, and 3 from Figure 
16A The increase in absorption was a function of the concentration of dye in the tissue 
at a particular time. The graph labeled "tumor tissue" is a plot of the dynanucs of the 

35 absorption changes within box 1 from Figure 16 A. The graph labeled "tumor surround" 
is a plot of the dynamics of the absorption changes >^thin box 2 from Figure 16A The 
graph labeled "normal brain" is a plot of the dynamics of the absorption changes within 
box 3 torn 16A 
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Figure 18 shows dynamic imaging of dye uptake reveals residual traces of tumor 
cells in resected tumor margins. TUs is a continuation of the study on the same animal 
shown in Figures 14 through 17. Figure 18A shows a lugho' magnification image of the 
left hemisphere tumor margin of the animal after the tumor has been resected. Boxes 1 
5 are over areas that contain small traces of reddual tumor cells, and boxes 2 are over 
areas containing only normal tissue. The gray-scale bar indicates the magnitude of 
optical change in the difference images. Figures 18B, 18C, and 18D show difference 
images of the tumor mar^n 4, 30, and 60 seconds after intravenous dye injection 
respectively. Minute biopdes were taken from areas that showed preferred dye 

10 containment and from areas from which the dye cleared rapidly. These biopaes were 
analyzed blindly and later correlated to the location from v^ch the biopsies were taken. 
Those biopaes taken from areas whidi cleared dye were shown to contain only normal 
cells, whereas biopsies taken from areas wluch sequestered dye were shown to contain 
tumor cells. Extremely small islands of reddual tumor can be mapped vdthin the tumor 

IS margins. 

Figure 19 shows dynamic information of dye uptake and clearance in tumor vs. 
non-tumor tissue. This is a plot of an average of the percentage change in emr 
absorption average over the spatial areas indicated by boxes 1 and 2 from Figure 18 A. 
The increase in absorption is a function of the concentration of dye in the tissue at a 

20 particular time. The graph labeled "margins tumor is a plot of the dynamics of the 
absorption changes within box 1 from Figure 18A. The graph labeled "margins normal** 
is a plot of the dynamics of the absorption changes vydthin box 2 from Figure 1 8 A. This 
data as well as that from Figure 1 8 show that the inventive device and method are able 
to distinguish tumor from non-tumor tissue vdthin tumor margins with extremely high 

25 spatial and temporal resolution. 

DETAILED DESCRTPTTON OF THE INVENTION 

The present invention provides an apparatus for imaging neuronal intrinsic 
signals in real time and for determining the presence, size, margins, dimensions, and 

30 grade of a solid tumor mass using a dye. The present invention further provides a 

method for functional mapping of the cortex in a patient by mapping intrinsic signals in 
real time, a method for determining the presence, size, location, and grade of solid 
tumor tissue in real time without the sampling errors of biopsies or the delay of and 
possible misdiagnosis of the pathologist's frozen section analysis, and a method for 

35 imaging nerve tissue that may be phy^cally damaged or surrounded by and adjacent to 
tumor cells. The inventive methods employ a similar apparatus, comprising a series of 
components, including video input hardware and dedicated image processing hardware. 
The video input hardware is, for example, a photo-detector, such as a CCD (charge 
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coupled device) camera (preferably a COHU 6510 CCD Monochrome Camera with a 
COHU 6500 dectronic control box made by COHU Electronics San Diego, C A). In 
some cameras the analog agnal is digitized 8-bits deep on an ADI board (analog-to- 
di^tal board). The dedicated image processing hardware is generaDy controlled by a 

5 "host computer". The host computer is any common general computer (such as an 
IBM PC type with an Intel 386, 486 or better microprocessor or Sun SPARC) that is 
interfaced with the dedicated imaging hardware and sends commands to the ima^g 
hardware that direct data flow, computations, image acquisition and the like. Thus, the 
host computer directs the actions of the imaging hardware and provides the user 

10 inter&ce. 

Definitions 

The fpllovdng are definitions of commonly used terms and that are applied in 
this application according to their art-accepted usage, such as described in Inoue, Video 
15 Microscopy Plenum Press, New Yoric, 1989. 

Area of Interest is that area of tissue that comprises the subject of the image. 
Arithmetic Logic Unit (ALU) is the hardware component that performs a variety 
of mathematical and logic operations (e.g., sum, difference, exclusive or, multiply by a 
constant, etc.) on the image signal at extremely high speeds. 
20 Averaged Control Image is that updateable image that is the average of a series 

of real time images over a period of time. . 

Charge Coupled Device (CCD) is a photo-sensitive alicon chip used in place of 
a picicup tube in miniature \adeo cameras. 

Difference Image is the manipulated image created by adding or subtracting a 
25 subsequent image or a particular image in time fi^om an averaged control image. 
Frame is a single digitized array of single video pictures. 
Frame Buffer is a piece of hardware that serves as a temporary storage of a 
firame, such as an averaged control image, a subsequent image or a difference image. 
Geometric Transformation (Gonzalez and Wintz, Digital Image Processing, 
30 Addison-Wesley Publishing Co., Reading, 1 987) generally modify spatial relationships 
between pixels in an image. For this reason, geometric transformations are often called 
"rubber sheet transformations" because they can be viewed as the process of "printing" 
an image on a sheet of rubber and stretching this sheet accor(ting to a predefined set of 
rules. As applied to video imaging, subsequent images can be viewed as having been 
35 distorted due to movement and it is desirable to "warp" these images so that they are 
similar to the control images. Geometric transformations are distinguished fi-om "point 
transformations" in that point transformations modify a pbceFs value m an image based 
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solely upon that pixd*s value and/or location and no other pixel values are involved in 

the transformation. 

Image is a frame or compoation of frames that have been altered after 

digitization, such as processing a sequence of frames into an avenged control image or 
5 a subsequent averaged image. 

Intrinsic Signal means a detectable change in reflectance properties of neuronal 

tissue due to endogenous physiologic activity. Possible causes of intrinsic signals 

include, for example, membrane depolarization, glial cell swelling, ion flux across 

neuronal membranes, blood volume changes, blood deoxygenation (hemoglobin to 
10 deoxyhemoglobin), tissue oxygenation and combinations thereof 

Linear HSstogram Stretch is a transformation in vAidtk the values between two 

points (high, low) are remapped to cover a fiill range of values (i.e, dynamic range). 

For example, the low value is mapped to zero, the Mgh to 2SS, and the intermediate 

values are mapped to linearly increasing brightness values. All brightness values below 
1 5 the low value are set to zero and all brightness values above the Ugh value are set to the 

high value. 

Look Up Table fLUD is a piece of hardware that functions to store memory 
that directs conversion of the gray value of each pixel into another gray value or color 
that is spedfied by the LUT, The LUT can be programmed to manipulate image 
20 contrast, threshold an image, apply pseudocolor and the like (such as a convenient 
implementation method for point processing algorithms). In the case of the present 
invention, the LUTs are, preferably, implemented for speed on an ADI and/or ALU 
boards. 

Paradigms cause a change in electrical aaivity of an area of cortical tissue 
25 dedicated to a specific function {e.g., speech, language, vision, etc.) thus causing an 
increase or decrease in what is called an intrinsic signal. 

Pbcd is the individual umts of image in each frame of the digitized signal. The 
intensity of each pixel is linearly proportional to the intensity of illumination before 
signal manipulation and corresponds to the amount of emr (photons) being reflected 
30 from a particular area of tissue corresponding to a particular pixel. It should be noted 
that an image pixel is the smallest unit of a digital image and its output intensity can be 
any value. A CCD pbcel is the smallest detecting element on a CCD chip and its analog 
output is linearly proportional to the number of photons it has detected. 

Processed Difference Image is the raw difference image that has been processed 
35 or manipulated to filter out noise or movement and increase the dynamics of effect of 
di£ferent pbcel values to illustrate events in the area of interest. 

Tumor Margin is the area where the surgeon has resected the tumor. 
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ApparatMS 

The inventive apparatus is made as one umt or a group of components. The 
first component is a high intensity emr.source. The emr source is for illuminating the 
cortical sur&ce or area of interest, such as an area suspected of having solid tumor 
5 tissue. DiflSM-OTt mtrinsic agnals can be illuminated by diflFerent wavelengths of emr. 
Moreover, the emr source must inchide the wavelengths of emr absorbed by the dye for 
the tumor imaging method. For exany)le, when the dye is indocyanine green, preferred 
wavelengths are from about 730 nm to about 840 nm. For other dyes, the preferred 
wavelengths of illuminating emr should include wavelengths at which the dye absorbs. 
10 The term emr instead of light is used because it is also possible to image in the infixired 
region of the spectrum outside of the visMc li^ range. 

When determining intrinsic signals from the cortex, reflected emr can be filtered 
to allow for ^ddeo imaging of only selected wavelengths of emr. Preferred sdected 
wavelengths of emr mclude, for ecample, fl-om about 500 nm to about 900 nm, or most 
15 preftOTbly, the near infi^rcd spectrum. Generally, k>ng«^wavelmgths(e.g-, 
{^proximately 800 nm) measure deeper cortical activity. 

Moreover, that part of the infrared spectrum in an invisible range of between 
0.75 to about 1000 micrometers allows for a determination of intrinsic signals through 
dura and skull, thereby allowing for a determination of intrinsic agnals through intact 
20 skull and dura and without the risks associated with neurosurgery. When using this 
range of far infrared wavelengths, an IR detector is a different device than a CCD chip 
for a ^sible analog camera. IR detectors are made from materials such as indium 
arserude, germanium and mercury cadmium telluride rather than silicon. IR detectors 
must be cryogenically cooled in order that they be sen^tive to small changes in 
25 temperature. For example, one IR imaging system is an IRC-64 infirared camera 
(Cindnnati Electronics, Mason OH). 

As heat reaches the surface of the cortex, it emits electromagnetic radiation in 
the range of about 3-5 or 8-14 microns. Others have attempted to image this emitted 
radiation (see, for example, Gorbach et al., •'Infrared Mapping of the Cerebral Cortex" 
30 Thermography 3 : 1 08, 1 989). However, according to the present invention these 
emitted wavelengths are filtered out and an IR detector instead of a CCD detector is 
used. An IR emr source is, for example, a Tunable IR Diode Laser fi-om Laser 
Photonics, Orlando, FL. The imaged wavelengths are different from body heat and 
images of changes in absorption and emr scattering can be obtained according to the 
35 inventive method. In the case of tumor images through intact skin and possibly bone, a 
dye that absorbs in the IR can be used (e.^., indocyanine green). Other useful dyes 
include, for example, Photofrin® derived fi^om a hematoporphyrin derivative (HPD) and 
absorbs light at 630 nm, mono espatyl chlorin.36 (NPeg, Nippon Petrochemical, Japan), - 
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benzoporphyrin derivative (BPD, Quadra Logic Vancouver BC), Evans Blue, and 
combinations thereof. 

Prefi^ly, the emr source is a higji intensity, broad spectrum emr source, such 
as a tungsten-halogra lamp and a cutoff filter for all wavelengths below 69S nm. Most 
5 prefCTably, the emr source is directed to the area of interest by a fiber optic means. An 
example of such a emr source is a fiber optic emr pas^g through a beam splitter, 
controlled by a D C. regulated power supply (Lambda, Inc.) and passed through a 695 
nm longpass filter. 

The inventive apparatus includes a means for obtaining an analog video signal of 

10 the cortex or area of interest. A preferred device for obtaining an analog video agnal is 
a charge coupled device (CCD) video camera which creates an output video signal at 
30 Hz having, for example, 512 horizontal lines per fiame uang standard RS 170 
convention. One such device is a CCD-72 Solid State Camera (Dage-MTI Inc., 
Michigan City IN) and another such device is a COHU 6500 (COHU, San Diego CA). 

15 The area of interest must be evenly illununated to better adjust the signal over a 

fill! ^mamic range. If there is uneven illumination in the area of interest, it will limit the 
dynamic range. Preferably a high intensity and difiiise or even lighting system is used. 
Techniques to obtain even illumination over the area of interest include, for example, 
diffuse lighting, image processing algorithms to compensate for uneven illumination on 

20 a di^tized image, a constant shade gray unage marker point in the area of interest as a 
control point, a wavelength cutoff fiker in fi-ont of the camera and/or emr source, or 
combinations thereof Preferably, a regulated power supply will prevent fluctuations in 
emr sources. A footplate system is an optical glass (sterile) contact'mg and covering the 
area of interest to provide a flatter contour. The footplate also retards tissue 

25 movement. 

The analog signal must first be adjusted to maximize sensitivity of detection (at 
the level of the analog signal and before di^ti^ng) to amplify the signal and spread the 
signal across the fiill possible dynamic range, thereby increasing sensitivity of the 
apparatus. 60 Hz noise (such as firom A.C. power lines) is filtered out in the camera 

30 control box by an analog filter. Such adjustments fiirther serve to enhance, amplify and 
condition the analog signal fi-om the CCD. One means for properly adjusting the input 
analog signal is to digitize this signal at video speed (30 Hz), and view the area of 
interest as a digitized unage that is converted back to analog. 

It is important to compensate for small movements of tissue or the patient 

35 during the imaging process. Larger patient movements require a new orientation of the 
camera and obtaining a new averaged control image. Compensating for movement can 
be done by mechanical or computational means or both. Mechanical means include, for 
example, placing a footplate over the area of interest wherdn the footplate comprises 
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Sterilized optical quality glass in a framing device, and/or securing the camera and 
possibly the emr source to the skeletal frame of the patient, and combinations of both. 
When the camera and/or emr source are attached to the skeletal structure of the patient, 
any patient movements mil not effect the image because the camera and ilhimination 
5 source will remain in a constant orientation to the area of interest, tht advantage of the 
footplate is that it retards tissue movement caused by arterial pressure and/or respiration 
and prevents changes due to evaporation of cerebrospinal fluid. Computational means 
include, for example, using functional control points in the area of interest and 
triangulation-type algorithms to compensate for movements of these control or tie 

10 points, and "image warping" techniques wha-eby each subsequent image is registered 
geometrically to the averaged control image to compensate for movement, and 
combinations of both techiuques. The image warping technique is described in, for 
example, Wolberg, "Distal Image Warping" IEEE Computer Society Press, Los 
Alimitos, CA 1990. The image warping technique can further indicate when movement 

15 has become too great for the averaged control image and that a new averaged control 
image must be taken. Control points can be placed directly in the area of interest, such 
as directly on the cortical surface for intrinsic ^gnal analysis. For example, Goshtasby 
("Piecewise Linear .Mapping Functions for Image Registration" in Pattern Recognition 
vol. 19 pp 459-66, 1986) describes a method whereby an image is divided into 

20 triangular regions u^g control points. A separate geometrical transformation is 
applied to each triangular region to spatially register each control point to a 
corresponding triangular region in a control image. 

If the two images (averaged control image and subsequent image) are 
misaligned prior to subtraction, artifacts vdU resuh since the diffidence image will be 

25 more like a gradient image amplifying noise and edge information. Image misalignment 
can arise from patient motion, heartbeat and respiration. One solution is to fix the 
camera to a ri^d assembly connected to the patient, such as his or her head such that 
any patient motion also moves the camera's field of view accordingly. Another solution 
is to perform real time motion compensation with motion detection and geometric 

30 transformation with the image processing board. Simple translation or more 

complicated (thus more accurate) unwarping can be implemented depending upon the 
input frame rate and amount of averaging. 

In the case of imaging tissue (either for neuronal acti>aty or for dynamical 
imaging of dye flow through tissue) in a human subject, it is necessary to compensate 

35 for the motion of the subject wluch may occur between the acquisition of consecutive 
images. 

For many types of images, it is pos^ble to compensate by a geometrical compensation 
which transforms the image by translation in the x-y plane. In order for an algorithm 
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such as tlus to be feasible, it must be computationally efiScient (preferably 
implementable in int^er arithmetic), m^iory eflBcient, and robust with respect to 
changes in ambient light. 

One possible method would be to translate an image by 0 through k numbo- of 

5 pixels in cveiy possible <Urection with respect to the control image. For each of the 
(2*k + l)*(2k + 1) translations, make a subtraction image and calculate some metric to 
estimate the closeness to the control image. An example of such a metric would be the 
variance of the subtraction image. The drawback of this method is that it is not effident 
since for each of (2*k+l)*(2k+l) subtraction images, we would need to calculate the 

10 variance over 512*512 pbcels. 

An eflBcient improvement of this algorithm is to estimate the variance of the 
subtraction images by randomly selecting some small number of areas of interest (for 
exan^le, 9 areas of interest), each area con»sting of a small number of pixels (say 8 x 
8) from the image that one wishes to translate with respect to the control image. Also, 

1 5 choose some search depth ( for example, 1 0 pixels) over whidi to translate these small 
areas of interest with respect to thdr corresponding areas of interest in the control 
image. After translation in all possible directions for 0 through 10 pfacds, choose the 
translation which minimizes the variance over the selected areas of interest. Since all 
the areas of interest are the same size, division is not necessary in the calculation of the 

20 variance which is to be ordered so that the minimal variance can be selected. Hence, all 
calculations can be carried out in integer arithmetic. Since the areas of interest are 
suflfidentiy small, most of the data can be read into the host computer's RAM limiting 
10 to the frame buffers and increasing speed. 

Another problem is guaranteeing uniformity in the illumination of the tissue 

25 sur&ce. Nonumformity comes from fluctuation in the illunnnation source and intenaty 
variations resulting from the three-dimensional nature of the tissue surface. Fluctuation 
in the illumination source is addressed by using a light feedback mechamsm to regulate 
the power supply of the illumination source. Both of these problems can also be 
compensated for in the image processing module. 

30 The analog video signal is continuously fed into a means for processing the 

signal. One such means for acquiring and analyzing data is an image analyzer {e.g.. 
Series 151 Image Processor, Imaging Technologies, Inc. Wobum MA). An image 
analyzer can receive and digitize an analog video signal with an analog to digital 
interface and perform such a function at a frame speed of about l/30th of a second 

35 (e.g., 30 Hz or "video speed"). Processing the signal involves first digitizing the signal 
into a series of pixels or small squares assigned a value (in a binary system) dependent 
upon the number of photons (i.e., quantity of emr) being reflected off tissue fix)m the 
part of the area of inta-est assigned to that pixel. For example, in a standard 512 x 512 
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image from a current technology CCD, there would be 262,144 pixels per image. In an 
8 bit system, each pixel is represrated by 8 bits. One can cool the CCD to reduce 
thermal noise. 

Preferably, the signal processing means includes a programmable look-up table 

5 ie.g., CMl 50-LUT16, Imaging Technology, Wobum, MA) initialized with values for 
converting gray coded pfacel values, representative of a black and white image, to color 
coded values based upon the intensity of each gray coded value. This provides image 
enhancement via an image stretch. An image stretch is a technique who-eby the highest 
and lowest pbcel intensity values used to represent each of the pixels in a digital image 

1 0 frame are determined over a re^on of the image frame wMch is to be stretched. 

Stretclung a selected region over a larg^ range of values permits, for example, easier 
identification and removal of relatively Mgh, spurious values due to noise (e,g., glare). 

Each image recdved is stored in the frame buffer, preferably within the context 
of a CPU as a frame of data elements represented, for example, as a 512 by S 12 array of 

15 pbcels. Each pbcel has a 8 bit value corresponding to one of 256 levels of gray. 

The processing means further includes a plurality of frame buffers having fi^e 
storage areas for storing frames of digitized image data received from the A/D interface. 
The frame storage area comprises at least one megabyte of memory space, and 
preferably at least 8 megabytes of storage space. An additional 16-bit frame storage 

20 area is preferred as an accumulator for storing processed image fiiames ha^g pbcd 
int^ities rq)resented by more than 8-bits. The frame buffers are temporary fest 
memory. The processmg means should include at least three fhune buffers. One is for 
storing the averaged control image, another is for storing the subsequent image and a 
tiurd is for storing a difference image between the averaged control image and the 

25 subsequent image. 

The processing means further includes an arithmetic logic unit (ALU) (e.g., 
ALU- 150 Pipeline Processor) for performing arithmetical (add, subtract, etc.) and 
logical (and, or, etc.) functions from data located in one or more frame buffers. An 
ALU is a fast processor. The ALU allows for image averaging in real time. For 

30 example, a newly incoming digitized image can be sent directly to the ALU and is added 
or subtracted to an averaged control image sitting in a frame buffer by passing both 
images through an ALU and adding them. After a last image is added, tWs 16 bh result 
can be sent again through an ALU wMch will divide this resuh by a constant (i.e., the 
total number of images). The output from the ALU is either stored in a frame bufifer, , 

35 sent for more processing, or used as its own input and again combined with another 
image. 
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It is important to compensate for patient movement in the digitized images 
before subtracting such images. Thus, geometric transformations are applied to the 
images so that they are geometrically r^stered prior to subtraction. 

The inventive apparatus can rahance procesang speed to create a difference 

S frame by adding a real time modular processor or fiister CPU chip to the image 
processor. For example, one real time modular processor is a ISO RTMP-150 Real 
Time Modular Processor (Imaging Technology, Wobum, MA). 

The processing means fiirther may include a means for poforming a histogram 
stretch of the difference frames {e.g.^ Histogram/Feature Extractor HF 1 5 1-1 -V 

10 module, Imaging Technology, Wobum MA) to enhance each difference image across its 
dynanuc range. A linear histogram stretch is described in, for example. Green, Digital 
Image Processing: A Systems Approach, Van Nostrand Reinhold, New York, 1983. A 
histogram stretch assigns the brightest pixel, or one ^th the Ughest value in the 
difference image and assigns this the maximum value. The smallest pbcd value is 

IS assigned the nunimum value and every other value in between is assigned a linear value 
(for a linear histogram stretch or a logarithmic value for a log histogram stretch, etc.) in 
between the maximum and minimum values. This allows the difference image to fully 
utilize the full dynamic range which provide for absolute changes. 

The image proces^g system can use a variety of hardware that is available or 

20 under development. For example, the Texas Instnmient Muhimedia Video Processor 
(MVP) is under development for motion video applications. The MVP uses a Wghly 
parallel internal architecture, large on-chip memory, and extremely high band^^dth 
communication ^thin CPU and between the CPU memory and I/O devices in order to 
pro\dde in excess of 2 billion RISC-type operations per second performance necessary 

25 to support the requirement of real-time video compres^on standards and real-time 
image capture, processing and visualization. For example, the hardware can comprise 
of printed circuit board modules with interfaces to a VME bus. A single chassis can 
house all of the modules and reside on a rack that is easily transportable in an operating 
room or between operating rooms, along with display monitors and peripheral input and 

30 output devices. The real time system, for example, comprises four boards for 
acquisition image processing, peripheral control and host computer. A minimal 
configuration with reducing processing capabilities comprises just the acquisition and 
host computer boards. The acquisition board comprises drcuitiy to perform real-time 
averaging of inconung video frames and allow readout of averaged frames at a 

3S maximum rate bus. A VME bus is preferred because of its high peak bandwidth 
(greater than 80 Mbytes/sec for the latest revision, VME64) and compatibility with a 
multitude of existing VME products. The acquisition board must also support many 
different types of cameras >aa a variable scan interface. A daughter board can support 
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the intofacing needs of many different types of cameras and supply variable scan agnals 
to the acquisition motherboard. Preferably, the unit comprises a daughter board 
into&cing to an RS-170A >adeo agnal to support a wde base of cameras. Other 
camera types, such as slow scan cameras with a hi^er spatial/contrast resohition and/or 

5 better signal to noise ratio) can be developed and incorporated into the inventive device, 
as well as improved daughter boards to accommodate such improved cameras. 

The host computer comprises a single-board embedded computer with a VME 
mter&ce. Preferably the host computer comprises a VME64 inter&ce, or a standard 
(IEEE 1014-1987) VME interface, depending upon bus bandwidth considerations. 

10 Example of host computer boards include, for example. Force SPARC/CPU-2E and 
HP9000 Model 7471. The user interface can be, for exanq)le, a Umx/X-Widow 
environment. The image processing board can be, for example, based upon Texas 
Instruments* MVP and other chips to perform real time image averaging, registration 
and other processing necessary to produce high quality difference images for 

15 intraoperative viewing. TMs board wll also drive a 120 x 1024 RGB display to show a 
sequence of difference images over time with pseudo-color mapping to highlight tumor 
tissue. Preferably, a second monitor is used for the host computer to increase the 
overall screen real estate and smooth the user interface. The processing board (fiilly 
programmable) can support a VME64 master inter&ce to control data transactions with 

20 the other boards. Lastly, a peripheral control board can provide electrical int^iaces to 
control mechanical inter&ces from the host computer. Such mechanical interfaces can 
include, for example, a computer-controlled, motor-driven syringe for dye injection, 
light source, and camera control box. 

The difference image signal is, preferably, fiuther processed to smooth out the 

25 image and remove high frequency noise. For example, a lowpass spatial filter can block 
high spatial fi*equencies and/or low spatial firequencies to remove high frequency noises 
at dther end of the dynamic range. This provides a smoothed-out processed difference 
image (in digital format). The digitally processed difference image can be color-coded 
by assigning a spectrum of colors to differing shades of gray. This image is then 

30 converted back to an analog image (by an ADI board) and displayed for a real time 
visualization of differences between an averaged control image and subsequent images. 
Moreover, the processed difference image can be superimposed over the analog image 
to display regions upon a video display of the area of interest, those specific tissue sites 
where the dye may have a fester uptake or where an intrinsic sgnal may be occurring. 

35 The present invention further inchides a means for subtractive procesang of 

difference images to identify cortical areas of neuronal inhibition. Normally areas of 
increased neuronal activity result in an increase of the emr absorption capacity of 
neuronal tissue (i.e., the tissue gets darker if >asible Ught is used for emr illumination, or 
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an intrindc signal increases in a positive direction). Similarly, a decrease in neuronal 
acti>dty results in a decrease of emr absorption capacity of the tissue (i.e., the tissue 
appears brighter, or intrinsic signals become negative). For example, image A is a 
subsequent averaged image and image B is an averaged control image. Normally, i^en 

S a pixel in image A is subtracted from a pixel in image B and a negative value results, 
this value is treated as zero. Hence, difiference images cannot account for areas of 
inhibition. However, the present invention provides a method for identifying both 
negative and poative intrinsic signals, by the method comprising: (a) subtracting image 
A (a subsequent averaged image) from image B (an averaged control image) to create a 

10 first difference image, whereby all negative pixel values are zero; and (b) subtracting 
image B from image A to create a second difference image whereby all negative pbcel 
values are zero; and adding the first and second difference images to create a "sum 
diffnrace image". The sum difference image shows areas of increased activity (i.e., 
color coded with warmer colors such as yellow, orange, red) and show areas of less 

IS activity or inhibition (i.e., color coded with cold^ colors such as green, blue, purple). 
Alternatively, one can overlay the first difference image on the second difference image. 
Either method provides an image of increased neuronal activity and decreased neuronal 
activity. 

Preferably, the processing means fiirther includes an optical disk for storing 

20 distal image data, a printer for providing a hard copy of the distal and/or analog video 
image and a monitor to provide for the physician to continuously monitor the difference 
fi^ame output (converted back to an analog signal) of the apparatus. The difference 
firame output may be superimposed upon the real time analog ^deo image to provide a 
video image of the area of interest (e.g., cortical surface or suspected tumor site) 

25 superimposed with a color-coded difference frame, in fix>zen time, to indicate where 
regions of &ster dye uptake have occurred and where there are intrinsic signals in 
response to some stimulus or paradigm. 

During a surgical procedure, there is often patient movement. In the case of an 
anesthetized patient, motion is often due to respiration and blood flow. In an awake 

30 patient, there will be additional movement. Movement must be compensated for in the 
digitized images so that the images are geometrically registered prior to subtraction. 
Geometric compensation is achieved by applying geometric transformations to the 
digitized images. One piece of image-processing hardware which can accomplish 
geometric transformations in real-time is a GP-ISO Geometrical Processor board 

35 (Informatique et Techniques Avancees, Issy-les-MouUneaux, France). The GP-1 50 
Processor board is compatible ^th hex hardware and performs real time rotations, 
translations, zooms, and second degree distortion corrections at video rates with 
bilinear interpolation onS12x512x 8-bit images. 
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Imaging Methods 

The method for imaging a solid tumor involves periodically admiiustoing a dye 
by bolus injection into vasculature {e.g., artery or vdn) perfiising the suspected tumor 

5 site in the area of interest. Preferably, the dye has a relatively short half life (e.g., less 
than five minutes) and is rapidly cleared to allow for repeated administration. The video 
CCD of the inventive apparatus is focused upon the suspected solid tumor site (area of 
interest) and high intensity emr containing the wavelength absorbed by the dye 
illuminates the site. Just prior to administration of the dye, the first averaged image is 

10 taken, digitized and stored in a fi^e buflFer. The dye is injected quickly and rapidly as 
a bolus. Subsequent image fi-ames are takra and stored and subtractively compared to 
produce difference images (eg., one or two per second) u^ng the inventive processing 
means. Iiutial visualization of the dye will appear in the difference image first in tumor 
tissue because the dye perfuses more r24)idly into tumor tissue. Solid tumor margins 

IS vnH be the first images to appear in the difference firame as darkened fines outlining a 
solid tumor mass. This difference fi^e can be firozen and stored to allow the surgeon 
to study the tumor image and identify tumor margins in real time during an operation. 
Moreover, the dye will remain for a longer period of time in tumor tissue compared to 
normal tissue. Therefore, after there is general appearance of the dye throughout the 

20 area of interest in both normal tissue and tumor tissue, the dye clearance in tumor tissue 
will be delayed, allowing another opportunity to visualize tumor margins by dye 
presence in tumor tissue but not in normal tissue. In more aggressive or malignant 
tumors, the higher the tumor grade, the longer the dye remains in tumor tissue. For 
lower grade or more benign tumors, the dye remains in tumor tissue for 45 sec to 2 min, 

25 whereas the dye can remain in more malignant tumors for up to 10 nunutes. 

The inventive method is superior to established tumor imaging techniques, such 
as MR] (magnetic resonance imaging) because optical imaging can distinguish low 
grade tumors that cannot be distinguished with current MRI techniques (MRI is not an 
intraoperative technique) and updated images are continually available during a surgical 

30 procedure by readministering the dye. The dye can be administered on multiple 
occasions during a surgical procedure after resection has begun to look at resected 
walls for residual tumor tissue. For CNS tumors, MRI techniques require an advanced 
stage tumor that has compromised the blood br^n barrier to be able to image such a 
tumor. The present optical imaging method, by contrast, can image evra low grade 

35 tumors that have not yet compromised the blood brain barrier. Therefore, optical 
imaging is a more sensitive technique than MRI. can be used intraoperatively, and 
provides an approximate means for grading tumors. 
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The dye can be any emr-absoibing dye that is safe for in vivo administration, and 
has a short half-life when administered intravenously or intraarterially. Example of such 
a dyes are indoqranine green, Photofiin®, NPeg, BPD, Evans Blue, and combinations 
thereof Further, during surgjcal resection of a solid tumor, it is unportant that the dye 

S be rapidly cleared from the area of interest. In that way, there can be repeBXed dye 
administrations to determine re^dual tumor tissue during resection. 

During an imaging study, it is important to continually update the av^^ed 
image frame to account for patient movement, particularly for an awake patient. This 
will account for circulating residual dye and patient movements or tissue movements 

10 due to surgical manipulation. 

For example, the inventive method for ^sualiang tumor tissue was utilized in a 
rat glioma model of the frontal lobe to test the ability of the inventive method to identify 
normal or edematous brain from tumor tissue and to detemune if the inventive method 
could separate normal from abnormal tissue after all vi^le tumor had been resected. 

1 5 The dynamic nature of the dye^s perfii^on through the brain's vasculature allowed for 
differentiation of normal brain and tumor tissue. Moreover, with a spatial resolution of 
optical images below 20 ^im^/pixel, even small areas of residual tumor can be identified. 
Further, tumor tissue was identified through intact rat skull, providing a method and a 
device for tumor imaging prior to surgery. 

20 Without being bound by theory, the dynamic differences in dye perfusion 

through normal brain tissue surrounding and tumor tissue could be accounted for by any 
one or a combination of the following four reasons: (1) greater extravasation of the dye 
through leaky tumor capillaries; (2) more n^id uptake of the dye by tumor tissue; (3) 
slower transit times through tumor tissue; and (4) preferential uptake of the dye by 

25 tumor cells. 

The rat glioma modd has been examined and microvasculature compared to 
normal cortex. Blood flow in tumor tissue is slower and more variable than in normal 
tissue. The diflFerence between tumor and normal brain have been attributed to tumor 
location, degree of infiltration, and necrosis. In other studies using cultured spheroids 

30 of C6 astroglial cells transplanted into rat brain, blood flow was slower in viable tumor 
than in normal rat brain. Microvessel volume fraction was equivalent between tumor 
and normal brain. However, since only about S0% of the tumor was actively perfused, 
the surface area of perfused microvessels in the tumor was one-half that of the normal 
brain. These changes could account for a slower flow of dye through the tumor 

35 compared to normal brain and also lead to more rapid clearance by the normal brain in 
contrast to the tumor. 

The permeability of tumor capillaries is much higher than in normal brain. 
Lealdness of these capillaries leads to extravasation of larger particles resulting in 
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edema and an increase in interstitial pressure surrounding tumor microvessels. Since 
tumor microvessels do not contain normal arteriole smooth musde, they also have no 
local control of pressure gradirats. This leads to a stasis offlow in tumor tissue. The 
overall effect on dye perfusion is long^ transit times than in normal brain and an 

5 increase wMch prolongs duration ofthe large optical signal from tumor tissue. Such 
reasoning supports the dynamic changes in optical signal from tumor and normal brain 
that was seen during dye perfusion. There is neariy equivalent uptake, but a much 
slower transit time in tumor tissue resulting in prolonged increases in optical signal. 
Also, tissue surrounding the tumor is expect to have increases in interstitial pressures 

10 but lAdthout leaky capillaries and other microvasculature changes, accounting for the 
fact that tumor tissue had an intermediate duration of optical changes. 

It is not clear whether a more rapid clearance mechaxusm of the dye from normal 
brain was occurring or if the dye was being preferentially sequestered by tumor cells. In 
the IdXesr case, hematoporphyrins are preferentially taken up into tumor cells, and 

15 accounts for the ability to use photodynanuc therapy on such cdls. If the dye remained 
completely intravascular, then a very uneven distribution of dye between normal and 
tumor cells would be expected. However, we observed the opposite from many 
intermediate images taken from areas between larger pial microvessels. 

The present invention further provides a method for imaging of cortical 

20 fimctional areas and dys&nctional areas, such as those areas of severe epileptic activity. 
The method involves adnunistering a sensory dgnal for mapping a particular cortical 
function, or identifying an area of hyperactivity that is the location of epileptic activity 
in an epileptic patient. An epileptigenic area of the cort^ will be ^dsualized as 
spontaneously more active and can be imaged by the inventive apparatus u^ng a 

25 method for mapping intrinsic signals of cortical activity. 

The method for visualizing intrinsic signals involves stimulating cortical tissue 
with specific paradigms. Various paradigms include, for example, presenting pictures of 
objects to a patient and asking the patient to name the object to alter neuronal activity 
which will result in an associated intrinsic signal. 

30 Another feature of the inventive apparatus and method is the ability to image 

peripheral nerve damage and scarring. Nerves of the central and peripheral nervous 
system (PNS) are characterized by the ability to regenerate after damage. During 
operations to repair damaged peripheral or cranial nerves, one can image areas of nerve 
damage by imaging areas of blockage of intrin^c signals. For example, the nerve is 

35 exposed in the area of interest. The nerve is stimulated upstream of the site of damage. 
The active nerve pathway is imaged by intrinsic signals in the processed difference 
frame after activation. The site of nerve damage or blockage is evidenced by an abrupt 
end or diminution to the intrinsic signal at the damage site. In tins way, the surgeon is 
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able to obtain real time information precisely where there is nerve damage and to 
correct the damage, if possible. 

Moreover, the inventive apparatus and ability to image mtrinsic signals can be 
used vyiien there is a need to remove tumor tissue that is located surrounding or 

5 adjacent to nerve tissue. For example a tumor called an acoustic noiroma is usually 
located surrounding an auditory (hearing) nerve. It is often a diflBcuh procedure to 
remove tumor tissue without severing the auditory nerve (a cranial nerve) and causing 
one ear to become deaf or damage the facial nerve that irmervates muscles that move 
the fiice. The inventive methods provide an ability to distingiush tumor tissue from 

10 surrounding nerve tissue using a dye. Additionally, the inventive method can 

continually provide information to the surgeon showing the precise location of the 
au<Utory or facial nerve by continually or periodcalty stimulating the nerve with a sound 
paradigm for the auditory nerve, or backfiring the facial nerve firom a &dal muscle, and 
detecting the intrinsic signal associated with nerve activity. Accordingly, when there is 

1 5 tumor tissue in close proximity to nerve tissue, one can use both the ability to locate 
tumor tissue with a dye and to locate nerve tissue by detecting intrinsic ^gnal using the 
same imaging apparatus. 

The ima^ng method can obtain information at the surface of an area of interest 
or can target an area of interest at a level deeper in tissue. Longer wavelengths of emr 

20 used to form the image (averaged control image and subsequent averaged images) can 
be used to probe areas of interest which are deeper into tissue. Moreover, if a 
difference image is created between the image seen with 500 nm emr and the image 
seen with 700 rmi emr, the difference image will show an optical slice of tissue. 
Moreover, instead of u^ng cutoff filters, administration of a dye can act as a tissue filter 

25 of emr to pro\d de a filter in the area of interest. In this instance, it is desirable to utilize 
a dye that remains with tumor or normal tissue for a prolonged period of time. 

The present invention fiirther comprises a method for enhancing sensitivity and 
contrast of the images obtained from tumor tissue or intrinsic signal difference images, 
comprising: (a) illuminating an area of interest with a plurality of wavelengths of emr, 

30 wherein there is at least a first wavelength of emr and a second wavelength of emr; (b) 
obtaining a series of fhunes corresponding to each wavelength of emr, wherein a first 
sequence of frames is from the first wavelength of emr, the second sequence offices 
is from the second wavelength of emr and so on; (c) proces^ng the first sequence of 
frames into a first averaged control image, the second sequence of frames into a second 

35 averaged control image and so on; (d) stimulating for intrinsic signals or administering a 
dye for tumor tissue imaging; (e) obtaining a first series of subsequent frames using the 
first wavelength of emr, a second series of subsequent firames using the second 
wavelength of emr, and so on, and processing the first, second and so on subsequent 
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series of frames into the first, second and so on subsequent averaged images, 
respectively; (f) obtaining a first (Ufference image by subtracting the first averaged 
control image from the first subsequent averaged image and a second difference image 
by subtracting the second averaged control image from the second subsequent averaged 
5 image, and so on; and (g) obtaining an enhanced diflFerence image by ratioing the first 
difference image to the second difference image. This can be accomplished, for 
example, with two single wavelength sources of emr, or by using a broad multiple 
wavelength source of emr and a phirality of longpass filters. Preferably, the 
monochromatic emr to illuminate the area of interest are from laser sources. 
10 The inventive apparatus and methods for imaging intrinsic signals and tumor 

tissue can operate out^de of a surreal procedure setting. More spedfically, it is 
possible to obtain tissue imaging through intact skin and bone. In some areas of the 
body longer wavelmgth visible light and near infi^ared emr can easily pass through such 
tissue for imaging, such as breast tissue. With dye injection, areas of increased 
IS vascularity, such as tumor tissue can be identified. 

Yet another aspect of the inventive method involves usmg an emr absoihing or 
fluorescent dye conjugated to a targeting molecule, such as an antibody, or more 
particularly, a monoclonal antibody or firagment thereof specific for an antigen surface 
marker of a tumor cdl. The area of interest is illuminated with emr containing 
20 excitation wavelengths of the fluorescent dye but not emission wavelengths. This can 
be accomplished by use ofacutofl'filter over the emr source. Preferably, the CCD 
camera is coupled to an image intensifier or micro channel plate {e.g., KS-1381 Video 
Scope International, Wash DC) to increase the sensitivity of the system by several 
orders of magmtude and allow for \isualization of cells having fluorescent dyes attached 
25 hereto. Examples of fluorescent dyes that can be conjugated to a targeting molecule 
include, for example. Cascade Blue, Texas Red and Lucifer Yellow CH from Molecular 
Probes Eugene OR. 

Still fiirther applications of the inventive device are possible. For example, the 
device can be used for calibration of electrodes used to electrically stimulate the cortical 
30 surface (see, for example. Figures 1 and 2). A technique presently used by surgeons to 
map the fiinctional organization of an awake patients cortex is to directly apply current 
(via stimulating-electrodes) to the surface of the cortex. The surgeon would like to 
apply the greatest intensity of stimulating current as possible without triggering an 
epileptic seizure or cau^g tissue damage. As a method of calibrating the stimulating- 
35 electrodes, the surgeon stimulates the cortex of the patient with currents of varying 
intensities and monitors the electrical activity by observing the output of recorcfing- 
electrodes which have been placed directiy on the sur&ce of the patients brain. The 
surgeon applies current for several seconds with the stimulating-electrodes and checks 
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the output from the recording-electrodes for afterdischaige q)3eptiform activity which 
may perast for a period of time after stimulation has ceased. The inventive de>dce 
provides an accurate means of monitoring spatial extent of the cortex afifected by the 
electrode stimulation current, and time course Of ^) of stimulation-evoked activity 

5 persisting after cessation of the stimulation current. The m^hod comprises acquiring a 
control image prior to stimulation, and then acquiring subsequent images during and 
after stimulation. The images are processed as described herein to provide a highly 
resolved spatial map of those areas of the cortex whose resting activity has been 
aflfected by the applied stimulating current. The inventive device provides a map of the 

1 0 spatial extent and timecourse of stimulation and epileptic activity, vMdi the surgeon 
can use to choose an appropriate stimulating current for his or her electrodes. 

It is also pos^le to utilize the inventive device for simultaneous spatial mapping 
of dynamic changes of blood-flow in blood vessels and cortical activity u^g intrinsic 
optical changes, (se^ for example. Figures 1 and 2) Wthout bring bound by theory, 

1 5 the intiin^c optical changes wthin regions of largCT blood vessels are due to a rate of 
change of the flow-rate within these vessels. The invention provides a method for 
monitoring these changes of flow within individual blood vessels. 

It is also possible to utilize the inventive device for a method to map fimctional 
organization of the cortex in an anesthetized patient during a neurosurgical procedure. 

20 (see, for example. Figure 5) A method comprises providing an aflferent sensory 
stimulation to activate an area of cortex specific to processing tins afferent sensory 
input, and using the evoked intrinsic signals observed with the inventive dersace and 
method to optically map r^ons of the cortex involved m the afferent sensory 
stimulation. 

25 For example, tiuring sui^cal removal of a tumor, the surgeon may need to know 

which area of cortex is involved in processing sensory input from a limb in an 
anesthetized patient. The surgeon can apply an afferent sensory input, such as a 
vibrating stimulus, to the limb to cause the conduction of information to that part of the 
cortex involved in sensory processing for this limb. This sensory stimulus will activate 

30 the 2q)propriate region of cortex which can then be mapped using the inventive device 
and method. Other examples of afferent sensory input include providing sound stimuli 
to activate auditory cortex, visual stimuli to map visual cortex, moving a joint, etc. This 
method is useftd for mapping certain fimctional areas in an anesthetized patient. 

It is also possible to utilize the inventive device for a method to md the surgeon 

35 intraoperative^ m the acquisition of biopsies from a tumor margin, (see, for example. 
Figure 12). After the surreal removal of a tumor, the surgeon is left with the task of 
trying to distinguish what areas of the tumor resection mar;^ contain remnants of 
tumor tissue. This is important since it is thought that in many tumor types, the 
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effectiveness of post-operative nuiiation aiid chemotherapy is correlated to the amount 
of tumor tissue left behind. The present technique of identifying these remnants of 
tumor is for the surgeon to remove small amounts of tissue in a random sampling 
fiishion and send these samples for analy^ to a pathologist. Tlus sampling and analysis 

5 must occur during the course of the surgery, since the surgeon needs this information to 
base his or her surgical dedsions as to what tissue ^ould be further resected. This 
technique suffers from several drawbacks, such as, the time required increases the 
length of the surgery thus increadng the cost and risk to the patient, and the random 
sampling method of determining biopsy sights is inevitably fraught with sampling error. 

10 The pr^ent invention provides a method for quickly determining the likely sites of 
roxmant tumor tissue i^thin a tumor marffn. This can as^st a swi^cal dedsion as to 
what areas of tissue should be sampled for biopsy purposes and which areas should be 
immediately removed a likely containing tumor tissue. 

IS EXAMPLE 1 

This example illustrates optical changes on a human subject by direct cortical 
electrical stimulation. Surface electrical recordings (surface EEG, ECOG) were 
correlated vnih optical changes. Figures 1 and 2 illustrate dynamic changes in intrinsic 
optical properties of human cortex during direct electrical stimulation of the cortex and 

20 during epileptiform activity. Figures A, B, C, and D, exemplify a typical optical 
ima^g study where the inventive device is utilized to provide dynamic information 
with high spatial resolution of the intrin^c optical changes of the human cortex during 
dther awake or anesthetized neurological surgical procedures. In Figure 1, intrinsic 
optical changes were evoked in an awake patient during stimulating-electrode 

25 "calibration". Four stimulation trials were sequentially applied to the cortical sur&ce, 
each stimulation evoking an epileptiform aiterdischage episode. A stimulation trial 
consists of: 1) monitoring resting cortical activity by observing the output of the 
recording electrodes for a brief period of time, 2)applying and electric current via the 
stimulation-electrodes to the cortical surface at a particular current for several seconds, 

30 and 3) monitoring the output of the recording dectrodes for a period of time after 
stimulation has ceased. 

A series of images (each iniage con^sting of an average of 128 frames acquired 
at 30 Hz) were acquired during each of the four stimulation trials. A current of 6 mA 
was used for the first three stimulation trials, and 8 mA for the fourtii. After a sequence 

3S of 3-6 averaged control images were acquired, a bipolar cortical stimulation current 
was applied (either 6mA or 8 mA) until epileptiform after discharge activity was evoked 
(as recorded by the surface electrode). Images were continuously acquired throughout 
each of the four stimulation trials. 



32 



wo 93/25141 



PCT/US93/05573 



The percentage change in absorption of light for each pixel was calculated for 
each image acquired during the four stimulation trials. The average percentage changes 
over the four areas (indicated by the four square regions marked in Figure 1 A) were 
plotted graphically in Figures IB, IC, and ID for comparison and analy^ of the 
S dynamic changes occurring in these four spatial areas. 

Figure 1 A is a view of a human cortex just anterior to face-motor cortex with 
one recording electrode (r) and two stimulating electrodes (s), and four sites (the boxed 
areas labeled 1, 2, 3, and 4) where the average percent changes of absorption over these 
areas were determined. The cortex was illimiinated with emr >690 nm. The scale bar is 
10 1 cm. 

Figure IB are plots of the percent change of emr absorption per second in the 
spatial regions of boxes 1 and 3 (as labeled in Figure 1 A). For both re^ons, the peak 
change is during the fourth stimulation trial (at 8 mA) in which the greatest amount of 
stimulating current had induced the most prolonged q)ileptiform afterdischaige activity. 

15 The changes vathin box 3 were greater and more prolonged than those of box 1 . Box 3 
was overlyuig the area of the epileptic focus (the exdtable area of tissue pos^bly 
responsible for the patients epilepsy). 

Figure IC show plots of the percent change of emr absorption per second in the 
spatial re^ons of boxes 1 and 4 (as labeled in Figure 1 A). Box 1 ov^lays and area of 

20 cortical tissue between the two stimulating electrodes, and box 4 overlays a blood 
vessel. The changes wthin box 4 are much larger and in the opposite direction of box 
1, and also that these changes are graded vnth the magnitude of stimulating current and 
afterdischarge activity. Since the changes in box 4 are most likdy due to changes of the 
blood-flow rate within a blood vessel, this plot shows that the invention can 

25 ^multaneously monitor cortical activity and blood*flow. 

Figure ID shows plots of the percent change of emr absorption per second in 
the spatial regions of boxes 1 and 2 (as labeled in Figure 1 A). Note that although these 
two areas a nearby each other, their optical changes are in the oppoate direction during 
the first three stimulation trials using 6 mA current. The negative going changes within 

30 the region of box 2 indicate that the invention may be used to monitor inhibition of 
cortical activity as well as excitation. 

All imaging procedures reported in this example and the patient consent form 
were reviewed and approved by the Uiuver^ty of Washington Human Subjects Re>dew 
Committee. All patients signed an informed consent statement for both the surgery and 

35 the imaging exp^ments. The cortex was evenly illuminated by a fiberoptic emr passing 
through a beam splitter, controlled by a D.C. regulated power supply (Lambda, Inc.) 
and passed through a 695 nm longpass filter. Images were acquired vdth a CCD 
camera (COHU 6S00) fitted to the operating nucroscope with a spedally modified 
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dneadaptor The cortex was stabilized with a glass footplate. Images were acquired at 
30 Hz and digitized at 8 bits (512 x 480 pbcds, using an Imaging Technology Inc. 
Series ISl system, Wobum MA). Geometrical transformations were applied to images 
to compensate for small amounts of patient motion (Wohlberg, Digital Imaging 

5 Warping, I.E.E.E. Computer Society, Los Alamitos, CA, 1988). Subtraction of images 
collected during the stimulated state (e.g., during cortical surface stimulation, tongue 
movement, or naming) from those collected during a control state with subsequent 
division by a control image resulted in percentage difference maps. Raw data (/.e., no 
digital enhancement) were used for determining the average optical change in specified 

10 regions (av^age sized boxes was 30 x 30 pbcds or 150-250 ^im^). For pseudocolor 
images, a linear low pass filter removed high frequency noise and linear histogram 
transformations were applied. Noise was defined as the standard deviation of 
fluctuations in sequentially acquired control images as 0.003-0.009. 

The optical changes between the stimulating dectrodes (site #1 in Fig. 1 A) and 

IS near the recording electrode (site #3) showed a graded response to the intensity and 
duration of each afterdischarge episode (Figure IB). The spatial extent of the 
epileptiform activity was demonstrated by comparing a baseline image collected before 
stimulation to those obtained immediately after stimulation. The intensity and spread of 
the optical changes were much less following stimulation #2 (shortest least intense 

20 afterdischarge episode) than after stimulation #4 (longest most intense afterdischarge 
episode). 

When the optical changes were below basdine, the sur&ce EEG recordings did 
not identify epileptiform activity (n = 3 patients) At site #3 in Figure 2A1, the optical 
changes after stimulation were below baseline (i.e., black re^ons in Figure 2A3). 
25 Howev^, during the fourth stimulation, the epileptiform acti\ity spread into the area of 
site #3 and the optical signal did not go below baseline until later (site #3, Figure IB). 
This negative optical signal likely represents inhibited neuronal populations (an epileptic 
inhibitory surround), decreased OT^gen delivery, or blood volume shunted to activated 
regions. 

30 Figure 3 shows a sequence of dynamic changes of optical signals identifying 

active areas and seizure foci. This Figure shows eight percentage difference images 
from the stimulation trial 2 described in the previous two Figures. Each image captures 
a two second interval. Note the focal area of greatest optical change in the center of 
images 4, 5, and 6 that indicates the region of greatest cortical acti>dty. The magmtude 

35 of optical change is indicated by the gray-scale bar in Figure 2. Each image maps an 
area of cortex approximately 4 cm by 4 cm. 

Figure 4 illustrates a real-time sequence of dynamic changes of stimulation- 
evoked optical changes in human cortex. Figure 4, panels 1 through 8, show eight 
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consecutive percentage difference images, each image is an average of 8 frames (< 1/4 
second per image). Each image maps to an area of cortex that is approximately 4 cm by 
4 cm. 

In Figure 6, stimulation moping of the cordcal surface was performed on 

5 awake patients under local anesthesia to idsttify sensory/motor cortex and Broca*s 
areas. During three "tongue wiggling*" trials images were averaged (32 frames, 1 sec) 
and stored every 2 seconds. A tongue wiggling trial consisted of acquiring 5-6 images 
during rest, then acquiring images during the 40 seconds that the patient was required 
to wiggle his tongue against the roof of his mouth, and then to continue acquiring 

10 images during a recovery p^od. The same patient was then required to engage in a 
"language naming" trial. A language naming trial consisted of acquiring 5-8 images 
during rest.(control images - the patient silently viewing a series of blank slides), then 
acquiring images during the period of time that the patient engaged in the naming 
paradigm (naming a series of objects presented with a slide projector every 2 seconds, 

IS sdected to evoke a large response in Broca's area), and finally a series of miages during 
the recovery period following the time when the patient ceased his nanung task (again 
viewing blank slides while remaining silent). Images Al and Bl are gray-scale images 
of an area of human cortex with left being anterior, right-posterior, top-superior, and 
the Sylvan fissure on the bottom. The two asterisks on Al, Bl, A2, and B2 serve as 

20 reference points between these images. The scale bars in the lower right comer of Al 
and Bl are equal to 1 cm. In Al, the numbo-ed boxes represent sites where cortical 
stimulation with electrical stimulating electrodes evoked palate tingling (1), tongue 
tingling (2), speech arrest-Broca's areas (3,4) and no response (1 1,12,17, 5-premotor). 
Image A2 is a percentage cfifference control hnage of the cortex during rest in one of 

25 the tongue wiggling trials. The gray-scale bar on the right of A2 shows the relative 
magnitude of the gray scale associated vnth images A2, A3, B2 and B3. Image A3 is a 
percentage difference map of the peak optical changes occurring during one of the 
tongue wiggling trials. Note that areas identified as tongue and palate sensory areas by 
cortical stimulation show a large positive change. The suppression of basehne noise in 

30 surrounding areas indicate that, during the tongue vdggling trials, language-motor areas 
showed a negative going signal. Image B2 is a percentage difference control image of 
the cortex during one of the language naming trials. Image B3 is a percentage 
difference image of the peak optical change in the cortex during the language naming 
task. Large positive go'mg signals are present in Broca's area, however native going 

35 signals are present in tongue and palate sensory areas. 

Figure 7 shows a time course and magnitude plot of the dynamic optical changes 
in human cortex evoked in tongue and palate sensory areas and in Broca*s area 
(language). Figure 7 shows the plots of the percentage change in the optical absorption 
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of the tissue mthin the boxed re^ons shown in Ftgure 6, images Al and B 1, during 
each of the three tongue wiggling trials and one of the language naming trials. Diagram 
7A shows the plots during the three tongue wiggling trials averaged spatially witMn the 
boxes 1, 2, 3, and 4 as identified in Figure 6, image Al. Diagram 7B shows the plots 

5 during one of the language naming trials averaged spatially within the boxes 1 -7 and 1 7. 
These results agree with those data reported by Lee et al. {Ann NeuroL 20:32, 1986) 
who reported large electrical potentials in the sensory cortex during finger movement. 
The magnitude of the optical changes in the sensory cortex during tongue movement 
(10-30%) parallels sensory/motor cortex studies where cerebral blood flow increases 

10 10-30% during motor tasks (Colebatch et al., J. NeurophysioL 65:1392, 1991). 
Further, utiliang Magnetic Resonance Imaging (MRI) of blood vohmie changes in 
human visual cortex during visual stimulation, investigators have demonstrated 
increases of up to 30% in cerebral blood volume (Belliveau et al.. Science 254:716, 
1991). 

J5 Optical images were obtained fi^om this same cortical region (/.e., area of 

interest) while the patient viewed blank slides and while naming objects on slides 
presented every two seconds. Percentage difference maps obtained during naming 
showed activation of the premotor area. The sites of speech arrest and palate tingling 
were identified by surface stimulation and demonstrate optical signals going in the 

20 opposite direction. The area of activation was clearly diflferent fi"om that evoked by 
tongue movement without speech production. The optical images of premotor cortex 
activation during nanung were in sinular locations to the cortical areas identified in PET 
single word processing studies (Peterson et al.. Nature 33 1 :585, 1991 ; and Fritii et al., 
1 Neuropsychologia 29:1 137, 1991). The optical changes were greatest in the area of 

25 the cortex traditionally defined as Broca*s area and not in areas where electrical 
stimulation caused speech arrest. 

Figure 8 illustrates an optical map of a cortical area important for language 
comprehension (Wernicke's area) in an awake human. Figure 8 image A shows the 
cortical surface of a patient where the anatomical orientation is left-anterior, bottom- 

30 inferior, with the Sylvan fissure running along the top. After optical imaging, all 

cortical tissue to the left of the thick black line was sur^cally removed. Sites #1 and #2 
were identified as essential for speech (e.g., cortical stimulation blocked ability of 
subject to name objects). At site #3, one naming error in 3 stimulation trials was found. 
As the surgical removal reached the area labeled by the asterisks on the tWck line, the 

35 patient's language deteriorated. All the unlabeled ates in Figure 8A had no errors while 
naming slides during cortical stimulation. Figure 8, image B shows an overiay of a 
percentage difference image over the gray-scale image of the cortex acquired during a 
language naming trial (see description for Figure 6 for description of the language 
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naming tiial). The magnitude of the optical change is shown in the gray-scale bar on 
the lower right of the image. This image dononstrates how a surgeon might use this 
invention intraoperatively to map language cortex. 

Figure 9 illustrates a time course and magnitude of dynamic optical changes in 

5 himian cortex evoked in Wernicke's area (language comprehension). Figure 9A shows 
plots of percentage change in optical absorption of tissue within the boxed re^ons 
shown in Figure 8. Figure 9A shows plots of boxes 1 and 2 overlay essential language 
sites, and boxes labeled 4, 5, and 6 overlay secondary language sites. Each of these five 
sights showed significant changes occurring while the patient was engaged in a 

10 language naming task. Figure 9B show percentage changes fi'om the six unlabeled 
boxes shown in Figure 8. There were no significant inoeases or decreases mthin these 
antoior sites. These data demonstrate that optical ima^g can also idoitify both 
essential and secondary language areas that must be preserved during neurosur^cal 
procedures. 

IS 

EXAMPLE 2 

This example illustrates indocyanine green imaging of a low grade tumor. A 
MRI scan was conducted before the operation. Additionally, the patient was 
investigated for tumor tissue using the apparatus described according to the invention 

20 and specifically used in Example 1. 

An averaged control image was obtained of the particular cortical surface area 
of interest. Indocyanine green dye was administered into a peripheral intravenous 
catheter as a bolus at time 0. Figure 1 0 illustrates differential dynanucs of dye to 
identify low grade human CNS tumor. TMs series of images are fix>m a patient having a 

25 low grade CNS tumor (astrocytoma, grade 1). In Figure lOA (upper left) the lettered 
labels placed upon the brain by the surgeon overlay the tumor as identified 
intraoperatively by ultrasound. However, tumors of this type and grade are notoriously 
difficuh to distinguish fi'om normal tissue once the surgical removal of the tumor has 
begun. Figure lOB (nuddle left) shows a difference image taken approximately 15 

30 seconds after intravenous injection of dye Ondocyanine green at 1 mg/kg). Figure IOC 
(lower left) shows the difference image about 30 seconds after dye administration. The 
area of the tumor tissue showed the first tissue staining. Figure lOD (top right) shows 
that in this low grade tumor, all tissue (both normal and abnormal) showed staining at 
45 sec after dye administration. Figure IDE (middle right) is one minute after dye 

35 administration and Figure lOF is five minutes after dye administration (showing 

complete clearance in this low grade tumor). These data show that indocyanine green 
enters low grade tumor tissue faster than normal brain tissue, and may take longer to be 
cleared fi'om benign tumor tissue than normal tissue. Therefore, it is possible to image 
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even low grade tumors with this apparatus/ Furthermore, it is possible to distinguish 
mtraoperatively low grade tumor tissue from surrounding normal tissue. 

Therefore, it is possible to image even low grade tumors by the inventive 
apparatus. Subsequent pathology of this tumor tissue established it as a low grade 
S glioma. 



EXAMPLE 3 

This example illustrates the image of a highly malignant CNS tumor 
(gilioblastoma). A patient was imaged in a neurosurgical procedure as described in 

10 Example!. The tumor ima^ng procedure was the same as in Example 2. The series of 
images in Figure 1 1 are from the cortex of a patient with a malignant CNS tumor 
(glioblastoma; astrocytoma, Grade IV). Figure 1 1 A (upper left) shows a gray-scale 
image in wluch malignant brain tumor tissue was densest in the center and to the right 
but elsewhere was mostly normal tissue (as was shown by pathology slides available one 

15 week after surgery). Figure 1 IB (middle Idl) is the diflFerence image at 1 5 seconds 

after intravenous injection of indocyanine green, showing the dynamics of dye perfiision 
in the first seconds in malignant tissue are similar to those in the first few seconds of 
benign tumor tissue (see Figure 1 1 C). Figure 1 IC (lower left) shows that at 30 seconds 
the malignant tissue is even more mtense by comparison to the normal tissue. Rgure 

20 1 ID (upper right, 1 nunute after dye injection) and HE Oower right, 10 minutes after 
dye injection) show that unlike benign tumor tissue, in malignant tumor tissue, dye is 
retained significantly longer, and in some cases, continues to sequester in the malignant 
tumor tissue over longer periods of time. Therefore, it is possible with this device to 
identify malignant tumor tissue, distinguisii mtraoperatively between normal and 

25 malignant tumor tissue, and to distinguish between the various grades of tumor {e.g., 
normal vs. benign vs. malignant). Thus, it is possible to not only image the location of 
tumor tissue, but also to grade the tumor with more malignant tumors retaining dye for 
a longer period of time than a lower grade tumor. 

30 EXAMPLE 4 

This example illustrates a series of images taken after resection of a malignant 
CNS tumor until the tissue appeared to be normal. This type of imaging of tumor 
mar^ns provides a novel method of real-time ima^ng of tumor mar^ns. After 
resection, the surgeon performed multiple histolo^cal margin sampling and when 

35 waiting for frozen section results, the images shown in Figure 13 were obtained. Figure 
13 shows a series of images and difference images of an area of interest where a tumor 
was resected- The area of interest was thought to be free of tumor tissue aftw the 
surgical removal of the tumor. Normally, in this size of a resection margin, only a single 
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frozen sample would be taken for pathology analysis. For the purpose of this study, 
five biopaes were taken from the margin to aid in correlating the histology with the map 
obtained by the invention. Figure 12A (top left) shows a gray-scale image of the tumor 
mar^. Figure 12B shows the margin with labels that the surgeon placed directly on 

5 br^. The purpose of these labels w^e to identify wh^e the surgeon was going to 
remove biopsy samples for histolo^cal analysis after difference images were acquired 
with the inventive device. Figure 12C (lower left) shows the diflference image 1 minute 
after intravenous injection of dye and Figure 12D (lower right) shows the difference 
image 10 minutes after dye injection. These post-dye difference images reveal a number 

10 of Sights that contain tumor tissue as well as areas of nontnal tissue. The accuracy of 
the optical ima^g was confirmed post operatively by analysis of the Uopsies. Note 
that a small area on the lower right of Rgure 12D indicates a posable region of tumor 
tissue that would not have been biopded by the surgeon. Hoice, even in the case of 
e>ctensive biopsy, the sampling OTor exceeds the accuracy of the invention. These data 

1 5 show that the invention is able to identify small rmnants of tumor tissue in a tumor 
mar^n aft^ resection of a tumor. As well, the invention could act as an aid to 
removing biopsies from the site of a tumor margin and reduce the innate sampling error 
associate with the presently used random sampling technique. 

20 EXAMPLE 5 

This example illustrates a means tor setting the CCD to optimize the apparatus 
to be able to detect signal ynih ma»mum sensitivity across a fiill dynamic range. The 
CPU should be programmed with software having the following features: (1) an output- 
analog signal, values of the image are close to saturating on the bright end (i.e., close to 

25 225) are displayed as a distinct color, such as red; (2) values that are dose to the dark 
end (/.e., are close to zero) are also displayed as a distinct color, such as blue. The 
following procedure is an example of an adjustment of the CCD camera. 

1 . With the gain and black-level on a camera-control box (CCB) initially set 
to 0, increase the emr intensity until the video signal is just saturating on the bright^d 

30 (/.e., some values in the output-analog signal can be seen to be close to 255). 

2. In crease the black-level on the CCB until the output image can be seen 
to be saturating on the dark end (/.e., some values in the output analog image can be 
seen to be close to 0). 

3 . Increase the gain on the CCB until some values of the output analog 
35 image can be seen to be saturating on the high end. 

4. Iterate steps (2) and (3) until either (a) the gain is set to its maximum 
posdble value, or (b) the black-level is set to its maximum possible value, or (c) the 
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image is maximally enhanced across is full dynamic range (that is, no further 
adjustments of CCB gain, black-level or emr source will improve the image. 

5. If in step (4) (a), the gain is set to its maximum level, or (b) the black- 
level is set to its maximum level, but the output image is still not maximally enhanced, 
5 then in the case of (a), decrease the settuig on the CCB gain slightly, increase the emr 
source intensity imtil just saturating the bright end, and return to step (2). In the case of 
(b), decrease the setting of the black-level slightly, decrease the emr intensity, and 
return to step (3). 

10 EXAMPLE 6 

This example illustrates a series of experiments uang a rat glioma model 
intraoperatively to investigate whether the inventive method and inventive de>ace could 
function in an operating room setting to provide real time information to the surgeon 
regarding resection of all tumor tissue. The rat glioma model is a standard predictive 

IS modd and was used to delineate dye uptake, clearance and overall parameters of optical 
imaging that resuh in the best images. The advantages of this model are the ability to 
consistently get reproducible tumors for imaging studies and to be able to rescect tumor 
under an operating microscope and still find residual tumor with the inventive optical 
imaging. A disadvantage of this model is the more sarcoma-like appearance of the 

20 tumor and a lesser degree of vascularity compared to human gliomas. 

Briefly, the rat glioma model uses an ethylnitrosourea-induced F-344 rat tumor 
line devdoped from a clonal population of a spinal malignant astrocytoma. TMs tumor 
is similar to human astrocytomas microscopically and in Wvo, because both have 
stellate-shi4)ed cells m the brain parenchyma and both have introcytoplasmic filaments 

25 80-100 \m in diameter as seen by scanning electron nuCTOscopy. The glioma cells were 
maintained in Weymouth's medium supplemented with 10% fetal calf serum. Viable 
cells (5 X 10^) were trypsinized from a monolayer culture and implanted stereotaxically 
into the right cerebral hemisphere of 30 syngeneic female rats, each weighing 140-160 
g. The stereotaxic coordinates for right frontal lobe implantation were 4.5 mm anterior 

30 to the frontal zero plane, 3 mm rights nun right from the midline and 6 nrni deep. The rats were 
anesthetized for implantation. The heads were shaved and scalps opened, and a 1 mm 
burr hole made at the appropriate coordinates. The cells were injected through a 27 
gauge needle, the needle left in place for 30 sec post injection and the hole was covered 
with bone wax. The scalp was sutured and the animals observed for 3-4 hrs until they 

35 returned to normal acti>dty and feeding. The ammals were used 10-14 days after tumor 
implantation. In this model, animals be^ to show clinical symptoms from the tumor by 
16-19 days, such as decreased activity and feeding, hemiparesis and eventually succumb 
between 19-27 days from mass efifects due to tumor expansion. 
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Fourteen animals underwent conq>liete study, including imaging before and after 
resection of the tumor. For study, the animals were anesthetized with 2% isoflurane, 
and the fraioral vein canulated for administration of the dye. Anestiiesia was 
maintained with a-chloralsoe (SO mg/kg adnunistered ip) and urethane (160 mg/kg 

S administered ip). The animals were placed in a stereotaxic holder. Imaging studies 
were then carried out before (see example 7 below) or afto* removal of the cranium. 
The tumor typically occupied the anterior one half to two thirds of the right hemisphere 
exposure. The compressed brain without any tumor infiltration was defined as the 
tumor surroimd to separate it firom the normal hemisphere on the contralateral side. 

10 Indocyanine grera was used as the intravoious dye. No dye was fouiKl in the 
cerebrospinal fluid after administration. 

The cortical surface was first imaged, and then an operating microscope was 
used to attempt gross total removal of the tumor. Sites were ibean chosen for biopsy 
based on optical imaging results and later analyzed histologicaUy. The biopsy 

1 S specimens were fixed in 1 0% paraformaldehyde, Nissl stained and mounted. All 
spedmens were read blindly and labeled either positive or native for tumor. These 
data were correlated to the optical imaging results to identify reddual tumor and 
statistical analysis (Chi square or student t-test) performed to determine the dgnificance 
of the results. 

20 The ima^ng apparatus is described herein. Light was fix)m a tungsten-halogen 

bulb related by a D.C. power supply, passed through a longiass fiker (690 nm), and 
through a right angled prism reflected through a 50 or 1 00 nun objective lens onto the 
cortical surface. The reflected light was collected by the same objective lens and 
focused by a projection lens onto the sur&ce of a CCD camera (COHU 6300). The 

25 imaging apparatus was attached to the stereotaTdc frame wluch was rigidly fixed to a 
vibration isolation table. Specially deigned automatic warping algorithms were 
designed to compensate for small amounts of movement. Images (512 x 480 pbcels) 
were acquired at 30 Hz and digitized at 8 bits (256 gray levels). Every 2 sec, a single 
image comprising 30 averaged frames was collected (1 sec) and then stored (1 sec). 

30 Control images were collected prior to injection of the dye and then for 2 min after dye 
injection. The dye injection was made over a 1 sec period while the last control image 
was being stored. A period of 20 min was allowed between dye injections to allow 
optical images to return to baseline. The initial control images of each trial were 
subtracted from each other to insure that the baseline starting point of each trial was 

35 equivalent. 

A single control inuige was chosen and then subtracted from each of the 
controls (4-6 images) and each of the post-dye injection images. The resultant image 
was divided by the original control image and multiplied by 100 to gjve a composite 
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percentage di£ference for the entire sequence before and after dye injection. The optical 
change that occurred between separate control images was 0.2-0.7%, whereas the peak 
changes resulting from dye injection were in the range of 5-40%. The control 
percentage difference image are represoited in the attached figures. The spatial 

5 resolution of an indi\ddual pixel in the image ranged from 13.5 x 1 1.7 juiA^ge2fff -380%. The contr 
^m^. Boxes measuring from 15-30 pixels per ade were drawn on the images. The 
average percentage change m the individual boxes was calculated and used to 
demonstrate graphically the optical dianges over time in the diflferent types of tissue. 
Imaging studies were performed on fourteen animals. The time course of dye 

10 perfiision through the tissue had a dynamic aspect. Optical imag^ig of indocyanine 

green dye perfusion at a dose of 1 mg/kg in 16 separate nms from a cortical surfiu^ in 9 
different animals demonstrated the dynamic nature of the optical changes. Figure 16 
show a sequence of images to illustrate the dynamic differraces of dye absorption 
changes between tumor and non-tumor tissue. Figure 16A shows a gray-scale image of 

15 the area of interest. This is the same animal as shown in Figure 16, however the 
craniimi has now been removed so as to expose the left hemisphere contaming the 
glioma, and the right hemisphere containing normal tissue. Box 1 overlays the tumor, 
Box 2 the tumor-surround, and Box 3 overiajrs normal tissue. Figure 16B shows the 
difference image of the area of int^ested 1 second after 1 mg/kg of indocyaiune green 

20 had been intravenously injected into the animal. During this iiutial rime, the tumor 
tissue is the first to show a measurable optical change indicating the uptake of dye 
occurs first in the tumor tissue. The gray-scale bar indicate the rdative magnitude of 
the optical changes in the sequence of difference images. Figures 16C and 16D show 
difference images of the area of interest 4 seconds and 30 seconds respectively after dye 

25 injection. At these intermediate stages dye appears to collect in both normal and tumor 
tissue. Figures 16E and 16F show difference images of the area of interest 1 minute and 
5 minutes respectively after injection of dye. At these later times, it becomes clear that 
dye is still collecting in tumor tissue even thought it is being cleared from normal tissue. 
The peak optical changes occur after 6 seconds from dye administration, but 

30 after the normal hemisphere be^ns to clear the dye, the tumor tissue continues to 
mmntain a large optical due to a lack of dye clearance. These changes localize 
anatomically to the tumor site. 

The optical signals begin to change witWn the first 2-3 seconds after dye 
injection and peak 6 seconds after injection in all three areas, tumor tissue, tumor 

35 suiTound and normal brain. However, the three different tissue types are differentiated 
by the rate of rise over the first four seconds, the peak optical change reached, and the 
eventual plateau that occurs after the first 30 seconds. The tumor tissue had a 
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sigmficantly different peak percentage difference change (40.5 ± 9.6%) than either the 
tumor surround (16.4 ± 6.8%) or the normal brain (9.7 ± 4.7%). 

Figure 17 is a plot of an average of the percentage change in emr absorption 
average over the spatial areas indicated by boxes 1, 2, and 3 from Figure 16A. The 

5 increase in absorption is a function of the concentration of dye in the tissue at a 
particular time. The graph labded "tumor tissue** is a plot of the dynamics of the 
absorption changes within box 1 from Figure 16 A. The graph labeled "tumor surround** 
is a plot of the dynamics of the absorption changes within box 2 from Figure 16 A, The 
graph labeled "normal brain" is a plot of the dynamics of the absorption changes withm 

10 box 3 from 16 A. This data as well as that from Figure 1 6 show that the inventive 

method and device is able to distinguish not only tumor from non-tumor tissue, but also 
tumor-surround areas which contain var^g densities of tumor vs. normal cells. 

Since the peak optical change was always reached 4-6 seconds after dye 
injection, there was also a significantly &ster rate of optical change in the tumor tissue 

15 compared to the tumor surround or the normal brain. A more rapid onset of dye 

perfiinon into the tumor tissue was displayed as a faster time course. Hie tumor tissue 
had a more rapid and greater rise time than dther the tumor surround or normal brain (p 
<0.01). 

An essential feature to be able to differentiate normal from abnormal tissue is 
20 distribution of the dye into three very different tissue compartments. In 13 of 14 

animals there was a prolonged increase (>2 min) in the optical signal in the tumor after 
the normal and tumor surround tissue had returned to basdine. Finally, even the normal 
and tumor surround tissue were sigruficantly different in dye uptake (rise time: normal 
2.4%/sec; tumor surround 4.0%/sec). Therefore, the dynanuc features of dye uptake 
25 and clearance are critical for detemuning the type of tissue involved in imaging 
resection maigins. 

The rat glioma model also provided an opportunity to look at ima^ng resection 
mar^ns once all visible tumor had been removed. Figure 18A shows a higher 
magnification image of the left hemisphere tumor margin of the animal after the tumor 

30 had been resected. Boxes 1 are over areas that contained small traces of residual tumor 
cells, and boxes 2 are over areas that contained only normal tissue. The gray-scale bar 
indicates the magnitude of optical change in the difference images. Figures 18B, 18C, 
and 1 8D show difference images of the tumor margin 4, 30, and 60 seconds after 
mtravenous dye injection respectively. Minute biopsies were taken froni areas that 

35 showed prefored dye containment and from areas from which the dye cleared rapidly. 
These biopsies were analyzed blindly and later correlated to the location from which the 
biopsies were taken. Those biopsies taken from areas wluch cleared dye were shown to 
cont^ only normal cells, whereas biop^es taken from areas which sequestered dye 
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were diown to contain tumor cells. The more rapid rate of rise seen in cortical surfitce 
imaging was still present for the resection margins that were po^tive for tumor 
compared to normal brain. Again, significant dififerences between the tumor and the 
normal bram existed for the rate of rise, peak optical diange, and plateau 60 seconds 

5 after dye injection (all p<0.01). Figures 15-18 dmionstrate that the inventive method 
and device can be used in combination with multiple ii^ections of dye for repeated 
application throughout a tumor resection surgery (in this case, 4 separate injections of 
dye were ^ven). Furthermore, extremely small islands of residual tumor can be mapped 
within the tumor mar^s. 

10 Sensitivity and spedficity of optical imaging was determined for 34 samples (n — 

12 animals) Of 15 biopsy sites deemed negative for tumor by optical imaging, 14 of 15 
were dear of tumor by histolo^cal anafyds (sensitivity 93%). Most of the specimens 
that were negative for tumor were taken firom the posterior wall of the tumor resection 
cavity or the depth of the cavity (where the hippicampus or denate gyrus were 

15 frequently Inopsied). Of 19 biopsy ates deemed positive for tumor by optical imag^ig, 
17 of the biopsy specimens were read as positive for tumor (spedfidty 89.5%). The 
two ates that were negative for tumor on histology but positive for tumor by optical 
imaging had increased cellularity but were deemed negative for tumor because there 
was no focus of tumor tissue present. The overall significance of these results are p < 

20 0.001. 

Figure 19 shows dynamic information of dye uptake and clearance in tumor vs. 
non-tumor tissue. Tins is a plot of an average of the percentage change in emr 
absorption average over the spatial areas indicated by boxes 1 and 2 from Figure 1 8 A. 
The increase in absorption is a fiinction of the concentration of dye in the tissue at a 

25 particular time. The graph labeled "margins tumor " is a plot of the dynamics of the 
absorption changes within box 1 from Figure 18 A, The graph labded "margins normal" 
is a plot of the dynamics of the absorption changes within box 2 from Figure 18 A. This 
data as wdl as that from Figure 19 show that the inventive device and method are able 
to distinguish tumor from non-tumor tissue witMn tumor margins with extremely high 

30 spatial and temporal resolution. 

EXAMPLE 7 

This example illustrates a series of experiments using a rat glioma model 
through an intact skull to investigate whetii^ the inventive method and inventive device 
35 could fiinction in to image tumor tissue through an intact skull and through intact skin 
prior to or after surgery. Far red wavelengths of emr are known to penetrate through 
bone and sidn. Imaging of tumor tissue was attempted through the intact skull of the 
rat. The extort of tumor identified was not as accurate as with the cortex exposed. 
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however, the area lying beneath the skuQ with tumor tissue was easly identified, 
localized and continued to concentrate dye after several minutes. Initially, after dye 
injection, the area of the tumor demonstrated a much larger signal than the normal brain 
of the contralateral hemisphere. One minute after dye injection, the dye had been 

S cleared fi-om the normal br^n and the only re^dual agnal remained in tumor tissue and 
the sagital/transv^^ anuses. 

Figure 14A is a gray-scale image of the cranial surface of a rat. The sa^tal 
suture runs down the center of the image. Tumor cells had been injected into the left 
side some days earlier so that this animal had developed a glioma on the left hemisphere 

10 of its brain. The right hemisphere was normal. Box 1 lays over the suspect region of 
brain tumor, and box 2 lays over normal tissue. Figure 14B is a difference image 1 
second after indocyanine green dye had been intravenously injected into the animal. 
The re^on containing tumor tissue becomes immediately visible through the intact 
cranium. Figure 14C shows that S seconds after dye injection the dye can be seen to 

15 profiise through both normal and tumor tissue. Figure 14D ^ows that 1 minute after 
dye iigection, the normal tissue has cleared the dye, but dye is still retained in the tumor 
region. The concentration of dye in the center of this difference image is dye circulating 
in the sagital sinus. 

The time course of optical changes imaged through the cranium from t^ runs in 
20 four animals are shown in Figure 15. The optical dianges were determined by the 
average optical change in a box placed directly over the tumor and over the normal 
hemisphere. The increase in absorption is a fimction of the concentration of dye in the 
tissue at a particular time. The graph labeled "extracraiual tumor" is a plot of the 
dynamics of the absorption changes within box 1 from Figure 14 A. The graph labeled 
25 "extracranial: normal" is a plot of the dynamics of the absorption change wthin box 2 
from Figure 14A. The peak optical changes for the tumor imaged through the cranium 
were 13.1 ± 3.9% and this was significantly greater compared to normal brain of 7.8 ± 
2.3% (p < 0.01), The plateau phase 60 seconds after dye injection was also significantly 
greater in tumor tissue (40.5 ± 9.6%) compared to normal brain (3.1 ± 0.7%) (p < 
30 0.01). 

EXAMPLE 8 

This example illustrates a rat model showing aaivation of sensory cortex by 
stimulation of a peripheral nerve. More specifically, afferent sensory input was 
35 generated in an anesthetized rat by directly stimulating the sciatic nerve. In Figure S, 
the leftmost image is a gray-scale image of hind limb somatosensory cortex in an 
anesthetized rat. The magmfication is sufiidentiy high so that individual capillaries can 
be distingiushed (the smallest vessels visible in this image). The center image is an 
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image of a percentage difference control optical image during rest. The magnitude of 
optical change is indicated by the gray-scale bar in the center of this image. The arrow 
be^de this gray-scale indicates the direction of increasing amplitude. The rightmost 
image is a percentage (tifference map of the optical changes in the hind limb sensory 
5 cortex during stimulation of the sciatic nerve. Therefore, it is possible to utilize the 
inventive device and method to map functional areas of the cortex corresponding to 
different areas of the body. 

EXAMPLE 9 

10 This example illustrates that diffoimtial dynamics of dye uptake and retention 

can characterize and identify tumor tissue in human patients that do not contrast 
enhance with traditional MRI imaging. A proportion of non-benign tumors are not 
observable with present MRI imaging techniques. The images in Figure 13 are from a 
patient whose tumor, did not contrast ^ihance with MRI. This lack of enhancement is 

1 5 usually typical of b^gn tumors. However, optical ima^ng was able to identify this 
tumor as a non-benign type (an anoplastic astrocytoma). Figure 13 A shows the gray- 
scale image of the area of interest. Figure 13B shows the difference image prior to dye 
injection. Figure 13C shows the area of interest 1 minute after intravenous dye 
injection, and Figure 13D shows the area of interest 5 minutes after dye injection. Note 

20 that the dye is retained in this tissue for a significant time. As shown in figures 10, 1 1, 
and 12, this dynamic trait is a characteristic of a non-benign tumor. 

EXAMPLE 10 

This example illustrates imaging of functional re^ons of peripheral nerves. A 
25 rat is anesthetised and dissected to expose the sciatic nerve. Using alver electrodes we 
electrically stimulate the caudal end of the nerve while acquiring a first sequence of 
difference unages. We note the extent of the spread of the intrinsic optical changes in 
the nerve from the point of stimulation by examining the difference imaging containing 
the peak optical change firom the control. Next, we make a crush in the nerve at a small 
30 distance anterior to the stimulating electrodes. We acquire a second sequence of 

difference images and compare the corresponding difference image from this sequence 
to the image containing the peak optical change from the first image. We note that the 
intrinsic optical changes diminish abruptly at the point where the nave was damaged. 
Finally, we stimulate the nerve anterioriy to where the crush was made and after 
35 acquiring a third sequence of difference images, we again note where the intrinsic 
dianges abniptly end. This method allows us to localize the location and &aent of 
damaged or disfunctional peripheral nerve tissue. 



46 



wo 93/25141 



PCr/US93/05573 



10 



EXAMPLE 11 

This example illustrates imaging of functiomd r^ons of Cranial Nerve Vin. 
Cranial nerve Vm (Vestibulocochlear nerve) is exposed. Soimd tones provide the 
auditory stumulus which eventually cause activation of this nerve. A sequence of 
difference images before, during, and after the q>pn)priate auditory sdmuli are applied 
show that intrinsic optical changes of the nerve are associated with its functional 
activiation. Next, a small region of this nerve is damaged by aushing. A second 
sequence of images reveal that auditory stimulation evokes intrinsic optical changes in 
the nerve up to the point of damage. 



EXAMPLE 12 

This example illustrates various methods for ^ihandng images obtained from 
tumor tissue or intrinsic signal difference images using multiple wavelength and/or laser 
illumination, and a method for extracting 3-D information using multiple wavelengths. 

IS We expose a region of cortex in an anestlused rat. First, Ohmunating with white li^t 
from a tungsten filament lamp, we acquire a sequrace of difference images prior to, 
during, and following electrical stimulation of i\ns region of cortex with bipolar 
stimulating electrodes. Next, we acquire second and third difference image sequences, 
following the identical procedure as we did for the first sequence, except that in the 

20 second sequence, the cortex is illuminated with with 690 nm and in the third sequence 
S 10 nm light. The change in wavelengths is accomplished by placing 690 ^ 1 0 nm 
interfo'ence filter oraS10:i:10nm interference filter between the lightsource and the 
brain. 

We compute the contrast-enhanced image by first ratioing a control 690 nm 
25 image with a control 510 nm image. Second, we ratio a 690 nm image during 

stimulation with the corresponding 5 10 nm image. We then combine the ratio images 
to compute the percentage difference image. In this maimer, the noise has been 
significantly reduced, hence the signal/noise ratio has been significantly increased. 

Next, we show how to extract depth information from the multiple wavelenght 
30 images that we have acquired. Longer wavelength light penetrates to a greater depth 
through the cortex, and shorter wavelength light to a lesser extent. Hence, the 690 nm 
image as penetrated cortex to x mm, and the 510 nm image toy mm where x<y. 

We subtract the 610 nm image from the 510 nm image, showing an "optical 
wedge" containing information fix)m a depth of (x -y) mm to x mm within the cortical 
35 tissue. By using a series of other mterence filters, we acquire a sequence of images 
containing information fi^m many different depths of the cortex. It is possible to 
acquire 3-dimentiona] information. 
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Next, exposing tumor tissue in a rat in vAndi we have induced tumor growth, 
we repeat all of the above experiments showing that in a Gke manna*, we can improve 
signal/noise and extract 3-dimentional information in tumor tissue. However, instead of 
stinmlating the tissue electrically, we inject the dyes indocyanine green or Evans blue. 

5 Finally, we repeat the above experiments by illuminating the cortex at several 

different wavelengths with a dye-tunable laser (a coherent source) instead of with the 
non-coherent tungsten filament lamp. With the laser (or any coherent source) we have 
the additional advantage in that we can seperate out the components of the signal due to 
changes in reflection or scattering. By illuminating the cortex with the laser directly 

10 parallel to the camera (both of which are perpendicular to the brain), we are ima^ng 
reflected light only. By moving the laser at an angje 8 to the camera, we are measuring 
changes due to scattering alone at tins particular angle. 

EXAMPLE 13 

1 S Tlus example ilhistrates a C code to implonoit the invaitive algorhithm and 

strategy for automatically translating a pair of images to the best fit wth a control 
image with translation in the x-y plane. One can implement the algorithm so that the 
inventive device can automatically translate subsequently acquired images to the control 
image so that motion will be compensated in an on-line &shion in the operating room. 

20 As well, it is clear the this algorithm can be implemented in integer arithmetic so that it 
is computationally efficient. Also, ance most of the memory required for this algorithm 
can be dynamically allocated, this algorithm makes efficient use of memoiy. 

Hus program automatically translates two images stored in the Imaging 
Technology 1 S 1 fi^e buffers to a best fit according to vAnch translation minimizes the 

25 variance of the subtracted images over the user-sdected areas of interests. The user 
specifies an image for firame buffer Bl and then specifies an image for fi*ame buffer 
ALOW to be automatically translated to the Bl image. If the number of areas of 
interest are less than 9 and the search depth is less than 8 then all the data can be read 
from the frame buffer into the host computer's RAM. This allows for speed and 

30 reduces the lO to the frame buffer. This program can be easily altered to use integer 
arithmetic only for all calculations. 

TWs program is compilable under Microsoft's C/C-h- Version 7.0 compiler 
Unked with Imaging Technology's ITEX run-time library. It will run on a PC 486 
compatible host computer controlling a Ik x Ik frame buffer, an ADI, and an ALU fi'om 

35 Imaging Technology's ITEX 1 S 1 series hardware. 

^include <stdio.h> 
#include <math.h> 
include <stdlib.h> 
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^include <conio.h> 

#inchide<itexl50.h> 

#include <graph.h> 

delude <float.h> 
5 #indude <dos.h> 

#define MEM_CHUNK 20 

#defineQUIT -1 

#defineGO -2 

#defineRADIX_10 10 
10 #define RETURN 13 

#defiiieESC 27 

#define CURSOR_UP 72 

#defiiieCURSOR_DOWN 80 

#defineCURSOR_RIGHT 77 
15 #defineCURSOR_LEFT 75 

#define CURSOR_JUMP_UP 141 

#defineCURSOR_JUMP_DOWN 145 

#define CURSOR_JUMP_RIGHT 1 16 

#defineCURSOR_JUMP_LEFT 115 
20 struct data_box{ 
int X, jr. 

int hdght, width; 

}; 

typedef struct data_box data_box; 
25 int box_oount = 0; 
int depth = 10; 
void initJ)ox_overlay(void); 

BYTE **ram_boxdata(data_box **map_ptr, int search_dq)th,int frameJbuflFer); 
data_box **define_boxmap(void); 
30 datajbox *draw_boxes(void); 

BYTE **diff_box(data_box **mapj)tr. BYTE **fbl, BYTE ♦♦fb2, 

int box,int x_oflF, int y_off); 
float sub_rects(data_box **mapj)tr, BYTE ♦♦diffjects, int search_depth, 

int ptr jjlace); 

35 BYTE ***difF_map(dataJbox **mapj)tr,int fbl , int fb2, int search^depth); 
float ♦suni_rects(data_box **mapj)tr, BYTE ***diffj-ects, int search_dq>th 
,int av_flag); 

int *min_boxset(data_box **map_ptr, float *floatj}tr, int search^depth); 
float *var_rects(dataJ)ox **mapj)tr, BYTE ***difF_rects, int search_depth, 
40 int av_flag); 

data_box **define_boxniap(void) /* returns a pointer to an array of boxes */ 

{ 

int i = 0, maxbox = MEM_CHUNK; /* dynamically allocate mem in 20-box */ 
int error_flag = 0, inchar; /♦ chunks. */ 

45 data_box **group_ofboxes; 
data_box ♦box jointer, 
int watch = GO; 

box_j)ointer = (data_box *)malloc(maxbox*sizeof(dataJbox)); 
if(box j)ointer = NULL) 
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printf("\nTROUBLE AT 70\n"); 
group_of_boxes = (data_box **)maUoc(inaxbox*sizeof(data_box *)); 
if (group_ofjboxes = NULL) 

printfl:"\nTROUBIJS AT 74\n"); I* FLAG 1 !!! •/ 

S else{ 

(watch != QUIT){ 
ifl^error flag = 0) { 

print£("Vn\nType ESC use drawJ>oxes \n\n"); 
inchar = getchQ; 
10 if (inchar = 0) 

getchO; 
if(ESC = inchar) { 
boxjcount = 1; 

init_box_overlayO; 
15 >)kiiile( watch != QUIT) { 

if (i >= maxbox) ( 

maxbox += MEM_CHUNK; 

group_ofJboxes = (data_box **XeaIloc(group_ofJboxes, 
nia^x*dzeoi(data_bax *)); 
20 if (group_ofboxes = NULL) 

printf("\nTROUBLE AT 91V);; I* FLAG 2 !!! */ 

} 

group_ofJboxes[i-H-] = drawJboxesO; 

printfCDo you want to draw box number %d ?\n", 
25 (box_count+ 1)); 

inchar = getchQ; 

if(inchar=0) 
getchO; 

ifCinchar=ESC) 
30 box_count-H-; 

else 

watdi = QUIT; 

} 

} 

35 } 
} 

) 

if(i < maxbox) { 

group_of_boxes ~ (datajbox **)reaIloc(group_ofJboxes, 
40 (i)*si2eof(dataJ)Ox *)); 

if (group_of_boxes = NULL) 
printf("\nTROUBLE AT 1 13\n-); 
} /* FLAG 3 !!!!*/ 

return(group_ofJ)oxes); 

45 } 

draw_boxesO is a simple function that draws boxes on the image for 
the user to view using the overlay capabilities of the ITEX 151 
ADI overlay capability. Its main fiinction is to return a pointer 
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to data_box structure containg the information for the location and 
area of the selected area of interest 

int cursjc = 235, cursjr = 220; 
5 data_box *drawJboxes(void) 
{ 

int dcurs_x,dcurs_jr, 
int x^start, y_start, x Jmgth, yjength; 
int text_diar,k; 
1 0 char box_number[3]; 

datajbox ♦box jwinter, 

box_pomter = (data_box *)malloc(sizeof(data_box)); 
ifl^ox jointer = NULL) 

printf("\nTROUBLE AT 131\n"); 
1 5 line(B2,0,curs_x-4,curs_y,curs_x+4,curs j^, 1 ); 
line(B2,0,curs_x,curs_y-5,curs_x,curs_jr+-5, 1 ); 
adiJutmode(DYNAMIC); 
k-0; 

x_start = y_start = xjength = yjei^ = 0; 
20 while (1){ 

text_char=getchO; 
if (text^char = RETURN) { 
+tk; 

dcurs_y=0; 
25 dcurs_x=0; 

if(k=l){ 

x_start = curs_x; 

y_start = curs_y; 

Iine(B2,0,curs_x-4,curs_y,cursjc+4,curs_y,0); 
30 line(B2,0,curs_x,curs_y-5,curs_x,curs_y+5,0); 
} 

if(k = 2) 
break; 

} 

35 dse if (text^char = 0){ 

text_char = getchQ; 
switch(text_char) { 

case CURSOR^UP: 
dcurs_y=-l; 
40 dcurs_x=0; 

break; 
case CURSOR^DOWN: 
dcurs_y=l; 
dcurs_x=0; 
45 break; 

case CURSOR_LEFT: 
dcurs_y=0; 
dcurs_x=-l; 
break; 
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case CURSOR JMGHT: 
dcurs_y=0; 
dcurs_x=l; 
break; 

5 case CURSOR__JUMP_UP: 

dcurs^y = -7; 
dcurs_x = 0; 
break; 

case CURSOR_JUMP_DOWN: 
10 dcursjF= 7; 

dcurs_x = 0; 
break; 

case CURSOR^JUMPJJEFT: 
dcurs_y = 0; 

15 dcurs_x = -7; 

break; 

case CURSOR_JUMP_RIGHT: 

dcursjr = 0; 

dcurs_x = 7; 
20 break; 

de&ult: 

dcurs_x = 0; 

dcurs_y = 0; 

break; 

25 } 

} 

else 

text_diar = -l; 

if((k = 0)&&(text^char !=-!)) { 
30 line(B2,0,curs_x-4,curs_y,curs_x+4,cars_y,0); 

line(B2,0,curs_x,curs_y-5,curs_x,curs_y+5,0); 
curs_x=max(min(curs_x+dcurs_x,51 1),0); 
cursjF=niax(min(curs_jrfdcurs_y,479),0); 
line{B2,0,curs_x-4,curs_y,curs_x+4,curs_y, 1 ); 
35 line(B2,0,curs_x,curs_y-5,curs_x,curs_y+5, 1 ); 

} 

elseif(k = l){ 

line(B2,0,x_start,y_start,x_start + x jength,y_start,0); 
line(B2,0,x_start,y_start,x_start,y_start + yjength,0); 
40 line(B2,0,x_start,y_start + yjength,x_start + 

xjength,y_start + yjength,0); 
Une(B2,0,x_start + x Jength,y_start,x_start + 

xjength,y_start + y Jength,0); 
cursx=max(min(cursx+dcurs_x,5 1 l^O); 
45 curs_y=max(min(curs_y+dcurs_y,479X0); 
x Jcngth = curs_x - x_start; 
y Jength = curs_y - y_start; 

line(B2,0,x_start,y_start,x_start + xjength,y_start,l); 
line(B2,0,x_start,y_start,x_start,y_start + yjength,!); 
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Iine(B2,0,x_start,y_start + y_length,x_start + 

xjength,y_start + yjength,!); 
line(B2,0,x_start + xjength,y_start,x_start + 

xjength,y_start + yjength,!); 

5 } 

} 

x_stait = min(x_start,x_start + xjength); 
y_start = minOy_start,y_start + yjength); 
xjength ~ abs(x length); 
10 yjength = abs(yjength); 

Jtoa(box_count,box_number,RADIX_10); 
(xjength < 10) || (yjength < 10)) { 
if (xjength > yjength) 

text(B2,0,x_start+x Jength/2-7,y_start-l 5, 
15 HORIZONTAL,l,l,box_nuniber); 
else( 

if(box_count < 10) 

text(B2.0,x_start-l l,y_start+yJength/2-2, 
HORIZONrAL,l,l.box_miniber); 

20 else 

text(B2,0,x_start-l 8,y_stait+yJength/2-2, 
HORIZONrAL,l,l,box_^nuniber); 

} 

} 

25 dse 

text(B2,0,x start+xJengthy2-5,y_stait+yJength/2-2, 
HORIZONTAL,l,l,box_number); 
boxjpointer->x = x_start; /* x coordinate */ 
boxj>ointer->y = y_start; /* y coordinate */ 
30 box_j)ointer->height = yjength; /* vertical length */ 
box_pointer->width = xjength; /* horiz length */ 
curs_x+=20; /* move cross-hairs to nearby location */ 
curs_y+=20; 
return box jointer, 

35 } 

void imt J)Ox_overlay(void) 

{ /♦ Clear B2, set path to B 1 , and overlay */ 

fb_setsmask(FRAMEB,OxOOFF); /♦B2onBl */ 

fb.clf(B2,0); 
40 select_j>ath(Bl); 

adi_hbanksel(l); 

adLhgroupsel(RED); 

ad!_clearlut(250); 

adLhgroupsel(GREEN); 
45 adi_clearlut(0); 

adi_hgroupsel(BLUE); 

adi_clearlut(0); 

) 

void jnh_itex_stuflE(void) 
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{ 

errjevel(2); 

load^cfg(""); 

imtsysO; 

5 } 

BYTE **ramJ)oxdata(data_box ♦*mapj)tr,int search_<iq3th, int framejbuflfer){ 
int ij,k,x_start,x_end,xjength,y_start,yjength; 
BYTE **iniage_rects; 
unsigned int count=0; 
1 0 unsigned int total_length=0; 
sdect_path(frame_buffer); 
for(i=K);i<box_count;i-H-) 

total Jength += (*mapj)tr[i]), width + 2*search_depth; 
image^rects = (BYTE **)malIoc(totalJength*sizeof(BYTE *)); 
15 if (image^rects == NULL) 
printfl["\n409\n'*); 
for(i=K);i<box_count;i++){ 

x_start = (*niapj3tr[i]).x - search^depth; 
x_end = (*niapj)tr[i]),x search_depth + (*map_ptrp]), width; 
20 X Jength = (*map_ptr[i]). width + 2*search_dq)th; 
y_start = (*niap_j)tr[i]).y - search_depth; 
yjength = (*mapjjtr[i]).height + 2*search_depth; 
for(j = xstartj < xend; j-H-){ 

image_rects[count] = (BYTE *)maIloc(si2eof(BYTE)*yJength); 
25 if CMnage_rects[count] = NULL) 

printf("\nSCREWUP 420\n"); 
fb_rvline(B 1 j,y_start,y Jength,iniage_rects[count]); 
count++; 

} 

30 } 

return(image_rects); 

} 

BYTE **difr_box(dataJox **mapj)tr, BYTE **fbj)trl, BYTE **fb_ptr2, 
int box_number,int x_of]^ int y_off){ 
35 unsigned int xjength, yjength; 

static unsigned int count l=0,count2^; 
int i j; 

static int old^number, 
BYTE ♦♦box; 
40 xjength = (*map_j)tr[box number]).width; 
yjength = (*map_ptr[box_number]).height; 
if (box_number = 0) 
old_number = 0; 
if (old_number != box__number){ 
45 countl += xjength; 

count2 += xjength + 2*depth; 
oId_number = boxjiumber, 

} 

box = (BYTE **)malloc(sizeof(BYTE *)*xjength); 
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i£(box = NULL) 

printf("\nScrewed at line 341 \n"); 
for(i=0;i<xJength;i-H-){ 

box[i] = (BYTE *)inaUoc(si2eof(BYTE)*yJength); 
^ if(box[i]=NULL) 

prmtfl["\nScrewed at 362\n"); 
forO=OJ<yJengtha++) 

box[i]D] = (BYTE)( abs(CmtXfbj)trl[i+countl]D]) - 

(int)(fbj)tr2[i4x_off4-coiint2][j+y_oflE]) ) ); 

} 

retum(box); 

} 

BYTE ***diflF_inap(data_box ♦♦mapjtr.int fbl, int fb2, int search_depth){ 
BYTE ***diff_rects,data_box, **fbl jtr, **fb2j)tr, 
int count= 0; 
intij,k,l; 

unagned int size, total_size = box_count*(2*search_depth + 1)* 

(2*search_depth + 1); 

size = 2*search_depth + 1; 

difF_rects = (BYTE ***)maUoc(sizeof(BYTE **)*totaI_size); 
if(difr^rects = NULL) 

printf("\nScrewed at 379\n"); 
fbl_ptr = ram_boxdata(mapj>tr,0,fbl); 
fb2 j)tr = raniJboxdata(map_ptr,search_depth,fl)2); 
for(i=0;i<box_count;i++) 
forO=Oa<sizey++) 

for(k = 0;k<fflze;k++){ 

diff_rects[count] = diflFbox(map_ptr,fbl j)tr,ft>2j>tr,i j,k); 
count-H-; 

} 

retum(diflF_rects); 

} 

float *suni_rects(dataJbox **mapj)tr, BYTE ♦**diff_rects, int search^depth, 

int av_flag){ 
unsigned int i j,k,l,m,count=0; 
float size = (2*search_depth + 1); 

float total_size = (2*search__depth + l)*(2*search_depth + l)*box_count; 
float *suiii_ptr; 

sumj)tr= (float *)calloc((unsigned int)total_size,sizeof(float)); 
if(sumj)tr = NULL) 

printf("\nSCREWUP AT 537\n"); 
for(i=0;i<box_count;i++) 
for (j=OJ<sizeJ-H-) 
for(k=0;k<size;k-H-){ 

for(l=0;l < (*map j)tr[i]).width; 1++) 
for(m=0;m < (*map j)tr[i]).hdght;m++) 

sum_ptr[count] += diflr_rects[count][l][ml; 
if(av_flag = ON) 

sum_ptr[count] = suni_ptr[count]/ 
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((*mjvj)trri]).width * (♦iiiapj)tr[i]).hdght); 

count++; 

} 

return(suinj)tr); 

5 } 

float *var_rects(dataJbox **map_ptr, BYTE ***diflF_rects, int search_depth, 

iiitav_flag){ 
unsigned int i j,k,l,ni,coum=0; 
float size = (2*search_depth + 1); 
10 float total_size = (2*search_depth + l)*(2*searchjdepth + l)*box_count; 
float *varj)tr,*avj>tr; 

avjtr = sum_rects(map_ptr,diff_rects,search_depth,av_flag); 

var_ptr = (float *)calloc((unsigned int)total_si2e,sizeof(float)); 
if(varj)tr = NULL) 
15 printf("\nTrouble at 477\n"); 

for(i=0;i<boxcount;i-H-) 
for (j=0 J<sizej-H-) 
for(lc=0;k<si2e;k++){ 

for<l=0;l < (*inap J3tr[i]).width; 
20 for(m=0;ni < (*map j)trp]).hei^t;ni-H-) 

varj)tr[count3 += ((floatXdiflF.rects[count][l][m]) 
- avj)tr[count])*((float)(diflf_rects[count]n][in]) 
- avj)tr[count]); 

count-H-; 

25 } 

free(avj)tr); 
retum(var_ptr); 

} 

int *min_boxset(data_box **mapjtr, float ♦float_ptr,int search_depth){ 
30 unsigned int ij,boxJump; 

float metric,min jnetric = FLT_MAX,poMtion=K); 
int shift[3]; 
divt divresult; 

box Jump = (2*search_depth + l)*(2*search_depth + 1); 
35 for(i=0;i<boxJump;i++){ 
metric = 0; 

for(j=Oy<boxcounta-H-) 

metric += float j)tr(j*box Jump + i]; 
if(metric < min_metric){ 
40 min_metric = metric; 

position = i; 

} 

} 

divresult = div((int)position,(int)(2*search_depth+ 1)); 
45 shift[0] = (int)position; 

shift[l] = depth - div_result.quot; 
shift[2] = depth - divj-esult.rem; 
retum(shift); 

} 
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int inmn(void) 
{ 

BYTE ♦♦♦mockjointer, 

char iinage[12]; 
5 databox ♦*mapjx)inter; 

int ♦statsj)tr,i; 

float *suin J3tr3; 

int *trans3; 

init_itex_stuflR3; 
10 fbJnitO; 

_clearscreOT( ^GCLEARSCREEN ); 

_settextposition( 10, 10); 

select_j>ath(Bl); 

_outtext("BASE Image : 
15 scanfl["%s'', image); 

im_read(B 1 ,0,0,5 12,480,image); 

_settextposition( 15, 10); 

select_palh(ALOW); 

_oxitt©ct("Image to translate : "); 
20 scanf("%s**, image); 

imj-ead(ALOW,0,0,512,480,tmagc); 

_settextposition(20,20); 

_oiittext("Search depth: "); 

scanf("%d",&depth); 
25 select j)ath(Bl); 

mapj)ointer = define_boxmapO; 

sumj)tr3 = var_rects(map j)ointer,mock j)ointer,depth,ON); 
trans3 = iiunJboxset(map j)ointer,sumj5tr3,depth); 
printfl["\nVARIANCE : pos = %d, x^trans = %d, y_trans = %d\n", 
30 trans3[0],trans3[l],trans3[2]); 
free(mockj)ointer); 
fi-ee(sum_ptr3): 
free(trans3); 

return 0; } 
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What is claimed is: 

1 . A method for ima^g margins and dimen^ons of solid tumor tissue 
located in an area of int^est, comprising: 

S a. illuminating the area ofinterestvdthemr containing the wavelength 

of erar absorbed by a dye; 

b. obtaining a video signal of the area of interest as a sequence of frames 
and processing the sequence of frames into an averaged control image; 

c. administering the dye by bolus injection into vasculature drculating to 
1 0 the area of interest; 

d. obtaining a series of subsequent frames of the area of interest over 
time and processing the series of subsequent frames into a subsequent averaged image; 

e. comparing each subsequent av^aged image ivith the processed 
averaged control image to obtmn a series of difference images; and 

IS f comparing each differoice image for e\ddenoe of changed absorption 

within the area of interest which is the outline of solid tumor tissue, wherein tumor 
tissue is characterized by faster absorption of and longer retention of the dye. 

2. The method of clmm 1 wherdn the dye is selected from the group 

20 consisting of indocyanine green, hematoporphyrin, fluorescein, fluorescamine, NPeg, 
BPD, Evans Blue, and combinations thereof 

3. The method of claim 1 wherein rates of change and nu^tude of each 
pixel are compared by: 

25 a. determining a baseline value of each pbcel for the wavelength of emr 

absorbed by the dye; 

b. administering the dye; 

c. obtaining a subsequent series of pbsel values for the particular 
wavelength of emr, 

30 d. subtractively combining a first averaged image frame from a 

subsequent averaged image to provide a difference image; and 

e. superimposing the difference image onto an analog image. 

4. A method for optically imaging functional and dysfunctional areas of 
35 interest of the cortex in a patient compriang: 

a. illununating the area ofinterest with high intensity emr; 

b. obtaining a video »gnal of the area ofinterest as a sequence of frames 
and processing the sequence of frames into an averaged control image; 
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10 



c. administering a paradigm to the patient to stimulate an intrinsic 

^gnal; 

d. oiytaining a series of subsequent firames of the area of interest over 
time and processing the series of subsequent fiames into a subsequent averaged image; 

e. comparing each subsequent averaged image with the averaged 
control image to obtain a series of difference images; and 

f comparing each difference image for evidence of an intiinac signal 
\^thin the area of interest, wherein an intrinsic signal is characterized by a change in 
reflectance properties manifest as a signal in the difference image. 



5. The method of daim 4 wherein the intrinsic signals are detected by an 
apparatus comprising: 

a. a means for obtaining analog video images and a means for 
processing the analog >ddeo signals into dther an averaged control hnage or a 

IS subsequent averaged image; 

b. a means for acquiring and analyzuig a phiraUty of subsequent 
averaged images and averaged control image to provide a difference image, wherdn the 
difference image is processed to account for movement and noise and amplify the 
changes across a dynamic range of the apparatus; and 

20 c. a means for displaying the difference image alone or superimposed 

over an analog \ddeo image. 

6. The method of claim S wherein the means for processing the analog 
video signals into dther the averaged control image or the subsequent averaged image 

25 comprises: 

a. a means for di^tizing the analog video ^gnal and processing the 
(Ugitized image across a fiill dynamic range; 

b. a means for averaging a series of frames into an averaged image and 
storing data from the averaged image frame in a first fi^e buffer; 

30 c. a means for storing each subsequent and processed digitized image 

data in a second fi^me buffer; 

d. a means for subtractively combining the averaged control image with 
a subsequent averaged image from the first and second firame buffers to provide a 
difference image, said difference image being stored in a third fi^ame'buffer, 
3S e. a means for processing the difference image to stretch the image 

across a Ml dynanuc range; 

f a means for color-coding the difference image; and 

g. a monitor for viewing a superimposed color-coded difference image. 
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7. An apparatus for imaging tumor tissue comprising: 

a. a means for obtaining analog video images and a means for 
procesang the analog video signals into dther an averaged control image or a 

5 subsequent image; 

b. a means for acquiring and analyzing a plurality of subsequent 
averaged images and an averaged control image to provide a difference image, wherein 
the difference image is processed to account for movement and noise and amplify the 
changes across a dynamic range of the apparatus; and 

10 c. a means for displaying the difference image alone or superimposed 

over an analog video image. 

8. The apparatus of claim 7 wherein the means for proces^g the analog 
video signals into dther the averaged control image or the subsequent ava:aged image 

IS conqnises: 

a. a means for di^tizing the analog video ^gnal and processing the 
di^tized image across a full dynamic range; 

b. a means for averaging a s^es of frames into an averaged control 
image and storing data from the averaged control hnage in a first frame buffer; 

20 c. a means for storing each subsequmt and processed digitized image 

data in a second frame buffer, 

d. a means for subtractivdy combimng the averaged control image mth 

a subsequent averaged image from the first and second fi^e buffers to provide a 

difference image, said (fifference image bdng stored in a third fiame buffer, 
25 e. a means for proces^ng the ^ffi^ence image to stretch the image 

across a full dynanuc range; 

£ a means for color-coding the difference image; and 

g. a means for superimposing the color-coded difference image upon an 

analog video image and a monitor for vie>^g this image. 

30 

9. The apparatus of clmm 1 or the method of claim 5, wherein the 
comparing steps (e and f) include a means for obtaining a digital image by subtractivdy 
combining at least two images, wherdn the two images are spatially translated rdative 
to one another by geometrical transformation. 

35 

10. The apparatus of clmm 8 or the method of claim 6, i^^ein steps (d) and 
(e) are replaced by a means for subtracting a subsequent averaged image from the 
averaged control unage to obtain a first difference image and subtracting the averaged 
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control image from the subsequent image to obtain a second difference image, and 
adding the first difference image and the second difference image to create a sum 
difference image showing areas of increased neuronal activity and areas of inhibited 
noironal activity. 

5 

11. A method for imaging damage to a peripheral or cranial nerve 
comprising: 

(a) illuminating an area of interest with emr, wherdn the area of interest 
comprises the peripheral or cranial nerve of interest including the suspected site of 

10 damage and a region upstream of the suspected site of damage; 

(b) obtaining a video signal of the area of interest as a series of frames 
and proces^ng the series of frames into an averaged control image; 

(c) stimulating the peripheral or cranial nerve at a site upstream of the 
suspected damaged ^te; 

1 S (d) obtaining a subsequent series of frames at the time of stimulation and 

processuig the subsequent series of fi^es into a subsequent averaged image; and 
(e) obtaining a difference image by subtracting the averaged control 
image from the subsequent averaged image to image the active region of the peripheral 
or cranial nerve, v/herdby nerve blockage is imaged as the point along the nerve where 

20 the intrinsic signal from the stimulated nerve abruptly ends or is altered in the difference 
image. 

12. A method for imaging a solid tumor tissue located in an area of mterest 
wherdn the area of interest is located underneath intact skin and/or bone, comprising: 

25 a. illuminatingtheareaofinterest with infrared region of emr, 

b. obtaining a video signal of the area of interest as a series of frames 
and processing the series of frames into an averaged control image; 

c. administering a dye by bolus injection into vasculature circulating to 
the area of interest, wherein the dye absorbs emr in a region of the infrared spectrum 

30 that is capable of penetrating through skin and bone tissue; 

d. obtaining a series of video images of the area of interest over time as 
a subsequent series of frames and processing each subsequent series of frames into a 
subsequent averaged image; 

e. comparing each subsequent frame with the processed averaged 
35 control frame to obtain a series of difference images; and 

f. comparing each difference image for evidence of changed absorption 
within the area of interest which is the outline of solid tumor tissue, whereby tumor 
tissue is characterized by faster absorption of and longer retention of the dye. 
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1 3 . The method of daim 1 2 wherein the changes in absorption rates of each 
pixel are compared by: 

a. determming a baseline value of eadipbcd for the wavelength of rair 
5 absoifoed by the dye; 

b. administering the dye; 

c. obtaining a subsequent series of pbcd values for the particular 
wavelength of emr; 

d. subtractively combining a first average image fi-ame from a 
10 subsequent image to provide a difference image; and 

e. superimposing the difference image onto an analog image. 

14. A method for ima^g functional and dysfunctional areas of interest 
within the CNS, wherein the area of mterest is located underneath intact skin or bone, 

15 compri^ng: 

a. illuminating the area of interest with infrared region of emr, 

b. obtaining a video signal of the area of interest as a series of frames 
and proces^ng the series of firam^ into an avowed control image; 

c. administering a paradigm to the patient to stimulate an intrinsic 

20 signal; 

d. obtaining a series of video images of the area of interest over time as 
a subsequent series of frames and procesdng each subsequent s^es of frames into a 
subsequent averaged image; 

e. comparing each subsequent fi^me with the processed averaged 
25 control frame to obtain a series of differmce images; and 

f comparing each difference image for evidence of changed absorption 
within the area of interest which is the outline of solid tumor tissue, whereby tumor 
tissue is characterized by faster absorption of and longer retention of the dye. 

30 IS. The method of claim 14 wherein the changes in absorption rates of each 

pbcel are compared by: 

a. detemuning a baseline value of each pixel for the wavelength of emr 
absorbed by the dye; 

b. administering the paradigm; 

35 c. obt£uning a subsequent series of pbcel values for the particular 

wavelength of emr, 

d. subtractively combining a first average image frame from a 
subsequent image to provide a difference image; and 
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